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Abstract 

Recent works of Alon-Shapira |6| and Rodl-Schacht \30l have demonstrated that every hereditary 
property of undirected graphs or hypergraphs is testable with one-sided error; informally, this means that 
if a graph or hypergraph satisfies that property "locally" with sufficiently high probability, then it can be 
perturbed (or "repaired") into a graph or hypergraph which satisfies that property "globally". 

In this paper we make some refinements to these results, some of which may be surprising. In the pos- 
itive direction, we strengthen the results to cover hereditary properties of multiple directed polychromatic 
graphs and hypergraphs. In the case of undirected graphs, we extend the result to continuous graphs on 
probability spaces, and show that the repair algorithm is "local" in the sense that it only depends on a 
bounded amount of data; in particular, the graph can be repaired in a time linear in the number of edges. 
We also show that local repairability also holds for monotone or partite hypergraph properties (this latter 
result is also implicitly in [20]). In the negative direction, we show that local repairability breaks down 
for directed graphs, or for undirected 3-uniform hypergraphs. The reason for this contrast in behavior 
stems from (the limitations of) Ramsey theory. 
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1 Introduction 



The purpose of this paper is to investigate various generalisations of some recent graph and hypergraph 
property testing results of Alon-Shapira|6|, Rodl-Schacht|30|, and others, when the graphs and hyper- 
graphs are allowed to become coloured, non-uniform, directed and/or containing loops. We also investi- 
gate a stronger property than local testability of such properties, which we call "local repairability". Very 
briefly, our conclusions will be that the local testability results of Rodl and Schacht extend to very general 
settings, but that the stronger local repairability results of Alon and Shapira are largely restricted to the 
setting of undirected graphs. 



1.1 Previous results 

Before discussing the general setting of coloured, non-uniform, directed hypergraphs in which our main 
results will take place, we first discuss the more familiar setting of monochromatic, uniform, undirected 
graphs and hypergraphs, which is the focus of most of the previous literature on this subject. 

We begin with the property testing theory for (monochromatic, undirected) graphs G = {V, E), where V 
is a finite vertex set and E C (^) a set of edges in V. One can also view such a graph as a mapH 
G2 '■ (^) — > {0, 1}, where G2({w, w}) equals 1 when {v, w} lies in E and equals zero otherwise. The set 
of all graphs on a fixed vertex set V will be denoted 

A graph property V is an assertion which holds true for some graphs and not for others. More formally, 
such a property assigns to each vertex set V a collection T't^) c {0, l}''^^ of graphs on V, defined as the 
set of graphs on V that obey V. Thus, for instance, if V is the property of being bipartite, then T't^) is the 
collection of bipartite graphs on V. 

We will restrict attention to two special types of graph properties, namely the monotone and hereditary 
properties. A graph property V is hereditary if, for every injection 4> : V ^ W between two finite sets 

' We use (^) := {e C V : |e| = fc} to denote the fc-element subsets of V, and |e| to denote the cardinaHty of a finite set e. 

^The notational conventions in this section may seem somewhat odd, but will become clearer in the next section when we gener- 
alise these notions to coloured, non-uniform, and directed hypergraphs. The subscript 2, in particular, has to do with the 2-unifonn 
nature of graphs, i.e. that all edges consist of two vertices; the set {0, 1}, meanwhile, is there to emphasise the monochromatic nature 
of the graph. 
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V, W, and any graph G € on W obeying V, the pullback graph (or induced graph) {0, 1)2 (G) on 

V (defined by declaring an edge {vi, V2} to lie in {0, 1}'^\g) if and only if {0(wi), (f){v2)} lies in W) also 
obeys V; in other words, the pullback map {0, l}'^^ maps to V^^\ In particular, this implies that 
the graph property is invariant with respect to graph isomorphism, and is also preserved by passing from a 
graph G € 2(2) to an induced subgraph G [w^ 2(2) for any W C V. A monotone graph property is a 
hereditary graph property with the additional property that if one takes a graph in T'^^) and removes one 
or more edges from it, then the graph continues to have the property V. 

Example 1.1. The properties of being A-colourable, bipartite, or triangle-free are monotone (and hence 
hereditary). Given any fc > 0, the properties of being connected, or of avoiding either the empty graph on 
k vertices or the complete graph on k vertices are hereditary (but not monotone). The property of having 
an odd number of edges, or containing a Hamiltonian cycle, are neither monotone nor hereditary. It is not 
hard to show that a graph property V is monotone if and only if there is a (possibly infinite) family T of 
"forbidden subgraphs" , such that a graph G obeys V if and only if does not have any of the graphs in T 
as subgraphs, while V is hereditary if and only if there is a family of T of "forbidden induced subgraphs" 
such that a graph G obeys V if and only if it does not have any of the graphs in T as induced subgraphs. 
For further discussion of monotone and hereditary graph properties, see 

We now come to the key notion of testability. 

Definition 1.2 (Testability for graph properties). 0?!/ A graph property V is said to be locally testable with 
one-sided error, or testable /or short, if for every e > there exists N > 1 and a real number S > with 
the following property: whenever G = (V, E) is a graph with N < \V\ < 00 which locally almost obeys 

V in the sense that 

^^\{W e Q : G LwG V^'^'^}\ >l-5 (1) 

( thus most N -element induced subgraphs of G obey V ), then there exists G' = {V, E') obeying V which is 

close to G in the sense thatj^\EAE'\ <e. 

[2) 

Remark 1.3. See US}/ for a discussion as to why the above concept is equivalent to testability with one-sided 
error, as defined in h33'i . 

The following is the main result of (|6l: 

Tlieorem 1.1. [6] Every hereditary graph property is testable. 

See [lU for a history of this result and for a survey of the many prior results in this direction, including 
the earlier result in |5 | that every monotone graph property is testable. The proof of this theorem is rather 
intricate, involving repeated application of the Szemeredi regularity lemma, as well as Ramsey's theorem. 

Theorem I 1 . 1 l has been generalised in two different ways. Firstly, the work of R"odl and Schacht f30l found 
a somewhat simpler (but more indirect) argument, avoiding Ramsey's theorem and using only a single 
instance of the (hypergraph) regularity lemma, which extended Theorem 1 1.1 1 to the setting of hypergraph 
properties for fc-uniform hypergraphs G — (V, E), where k > 2 and E C (^). It is straightforward to 
extend all of the above definitions to the fc-uniform hypergraph setting, basically by replacing 2 with fc in 
all the above definitions; we omit the details (and in any case, we will also make further generalisations of 
these definitions in the next section). 

The main result of ll30l can now be stated as follows: 
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Theorem 1.2. fWl Let k>2. Then every hereditary k-uniform hypergraph property is testable. 

This builds upon a number of earlier hypergraph results which can be interpreted as testability results, such 
as the hypergraph removal lemma fT?], 1291 . ll32l or the induced 3-uniform hypergraph removal lemma in 
II23I . We refer the reader to |30| for further references and discussion. 

There is however a different way to generalise Theorem ll.il in which we stay in the setting of graphs, but 
instead replace testability by a stronger property which we call local repairability, and which is analogous 
to the notion of local correctability in the theory of error-correcting codes. (Actually, we will eventu- 
ally discuss two such properties, strong local repairability and weak local repairability, but we will only 
discuss the weak one for now.) For simplicity we now restrict attention to graphs rather than A;-uniform 
hypergraphs. 

To motivate this concept, recall that if G is a graph that locally almost obeys a testable property V, then it 
is guaranteed that there is a way to modify a small number of edges of G to create a graph G' which truly 
does obey V. We will refer to the act of replacing G by G' as repairing the graph G. However, note that 
no algorithm is provided in order to actually execute this repair; one can of course perform a brute force 
search among all possible candidate graphs G", but this will take a time which is at least exponential in the 
number of vertices and is thus impractical. It is thus of interest to determine whether a testable graph (or 
hypergraph) property V also comes with an "efficient" algorithm that can repair a graph G quickly. We 
will focus on a rather strong notion of efficiency here, namely that of a local repair algorithm, in which any 
edge of the repaired graph G' can be decided upon using only a bounded number of queries to the original 
graph G (which in particular implies that the entire graph can be repaired in time linear in the total number 
(' 2 ) °^ possible edges). More precisely, we seek repair algorithms which are given by a local modification 
rule, which we will define shortly. For technical reasons we will have to delete a small set A of "training" 
vertices in order to perform this rule; thus the rule will start with a graph G — {A^V,E) almost obeying 
V, where A 1+1 F is the disjoint union of a large vertex set V and a small set A of training vertices, and 
return a repaired graph G' — (V, E') which obeys V exactly, but for which the training vertices A have 
been deleted. 

To motivate the concept of a local modification rule, let us discuss (somewhat informally) a specific exam- 
ple of repairability, in which V is the property of being a complete bipartite graph. (For instance, one could 
think of the vertex set of a graph obeying P as a collection of positive and negative charges, with an edge 
between two vertices if they have opposite charge.) Now consider a large graph Go = V, £'0) obeying 
V, and "corrupt" it to create a new graph G — V, £') formed by adding or removing a small fraction of 
the edges to _Eo. (For instance, one could imagine a large collection of real-world charged particles A l+) V^, 
with an edge between two vertices v^wmEif the two particles are observed to attract each other in some 
(mostly reliable) measurement; in this case, the corruption between E and the "true" graph Eq would be 
caused by measurement error) Then G approximately obeys V. If one is given G (but not Go), we now 
consider the task of repairing G to form a graph G' = (V, E') close to G which obeys V. (Ideally, we 
would like G' to recover the original uncorrupted graph Go, but there is not enough information given to 
do so exactly, and will settle for obtaining a slightly different repaired graph G' which is still complete 
and bipartite.) Continuing our measurement example, this task would correspond to that of using the mea- 
sured attraction and repulsion data to assign "charges" to various particles, thus attempting to correct for 
corrupted measurements and giving a prediction as to what the "true" attraction between any two particles 
are. 

To do this, we first look at the restriction G [a of G to the training vertices A. If the training vertices 
were a sufficiently representative subset of the whole set A 1+1 (which, in practice, we will ensure with 
high probability by drawing A randomly from the vertex set of G), then we expect G [a to be very close 
to a complete bipartite graph. By performing a brute force search on A only, we can then find a complete 
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bipartite graph := {A, E'j^) on A which is very close to G [a (and thus, presumably, also close to 
Go [a- Note that while a brute force search on all of V is exponentially expensive, if A is bounded size 
then it will only take a bounded amount of time to locate G^. Let yl = Ai l±) ^2 be the partition of A 
corresponding to the complete bipartite graph G^ . (This partition is only unique up to interchange of the 
labels 1, 2, but this will not concern us.) We can then use this partition to create a partition y = Vi l+l V2 of 
the larger vertex set V, by the following rule: a vertex v will lie in Vi if it is connected to more vertices of 
A2 than to Ai, and in V2 otherwise. (Informally, G^ has "decided" which of the training vertices in A are 
positively charged or negatively charged, and then one tests those charged particles against any other vertex 
V to decide whether v should be classified as positive or negative only.) We then define G' = (V, E') 
to be the complete bipartite graph between Vi and V2. Clearly G' obeys V; and it is intuitively clear that 
if G is sufficiently close to Gq, and A is sufficiently large (but still bounded) and drawn randomly from G, 
then G' will be close to G with high probability. (In particular, if G was exactly equal to Go, one easily 
sees that G' is equal to G.) 

Now we make these concepts more precise. 

Deflnition 1.4 (Local modification rule). A local modification rule is a pair {A, T), where A is a finite set, 

andT : 2v 2 J _> ^Q^lJ is amapfrom graphs on ALi[2] to {0,1}, where [2] := {1,2}, which is symmetric 
with respect to interchange of the 1 and 2 labels. Given any vertex set V, we define a modification map 
T : 2^ 2 ' ^ 2y^ ' by declaring an edge {vi, V2) in V to lie in T {G) for some G G 2^ 2 ) if and 
onfy?/T({0, 1}^''*-*®'^^(G)) = 1, where i(lA®(l> : A W [2] ^ {wi.Wa} is the map which is the identity 
on A and maps 1,2 to vi,V2 respectively. 

Example 1.5. The rule G ^ G' defined in the preceding discussion can be viewed as a local modification 
rule, in which T{G) for G G 2\ ^ ) defined by first constructing the graph G and the partition 
A ^ Ai\J A2 as above, and then [2] is partitioned into Vi U V2, and T{G) ~ 1 if 1,2 lie in distinct 
partition classes, andT[G) — otherwise. 

Remark 1.6. Informally, a local modification rule only has to query G between vertices in {vi, V2} U A 

to decide how vi and V2 are connected in G' :— T (G); furthermore; all pairs {vi, V2} are "treated 
equally " in the sense that the same modification function T is applied to each of them. There is also 
an equivalent category-theoretic definition of a local modification rule {A, T), namely it is a finite set A 

together with a natural transformation T, or more precisely a collection of maps T : 2^ ^ > 2^'^' 
for every vertex set V which obeys the natural transformation property 



for all injections cp : W V between two finite vertex sets V, W, where id^ 00 : AUW AUV is the 
extension of cf) which is the identity on A. This alternate characterisation of a local modification rule will 
be more convenient for us in later sections when we generalise to hypergraphs which may be multicoloured, 
non-uniform, directed, and/or infinite. 

Deflnition 1.7 (Weak local repairability). Let V be a graph property. We say that V is weakly locally 
repayable if for every e > there exists a finite set A, an integer N > \A\ + 2, and a S > with the 
following property: if G — {V, E) is a graph with N < \V\ < 00 which almost obeys V in the sense of 
([T]|, then there exists an embedding of A in V (thus identifying V with A 1+) V for some \V'\ = \V\ — \A\) 
and a local modification rule [A, T) such that G' = {V , E') T*^^ ^ (G) obeys V, and G' is close to G 
in the sense that 



T o{0,l}^ 



(idA ®<t>) 



{0,1}(*)oT' 




where E iv':=En (^'). 
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Remark 1.8. Observe that weak local repairability stronger than local testability in the sense that the 
repaired graph G' is given from G by a local modification rule, but weaker because one had to remove 
a small number of vertices; see Remark \l.36\ for further discussion. Also, observe that the embedding of 
A in V is not specified; also, the rule {A, T) is only guaranteed to produce a graph G' obeying V for 
the chosen input G. Later on we shall introduce the notion of strong local repairability, which roughly 
speaking is similar to weak local repairability, but the embedding of A in V is now chosen at random (and 
the algorithm has a small probability of failure), the rule [A, T) now entails the property V for all choices 
of input graph G, rather than being permitted to depend on G, and furthermore the graph G is allowed 
to be infinite (or even "continuous" ) rather than just finite (or discrete). However, to keep the discussion 
simple for now, we will not formally define strong local repairability until later sections. 

An inspection of the arguments in [6 1 then reveals the following strengthening of Theorem ll.il 
Theorem 1.3. Every hereditary graph property is weakly locally repairable. 

Strictly speaking, this result is not explicitly stated in |6|, but is an implicit consequence of their methods, 
together with the observation that Szemeredi partitions can be constructed using random neighbourhoods 
(see e.g. |fT9l ). In any event we will establish a stronger version of this theorem in the next section. 

Example 1.9. We have informally discussed this result in the case when V is the property of being a 
complete bipartite graph. Another illustrative example is the property of being triangle-free, which is a 
monotone property. The local testability of this property is a well-known fact, often called the "triangle- 
removal lemma ", and is due to Ruzsa and Szemeredi I134]I . To repair an almost-triangle-free-graph into a 
genuinely triangle-free graph, the standard approach is to apply the Szemeredi regularity lemma l[36]l to 
the graph, and then delete all edges between pairs of cells of that partition that are too small, have too 
low an edge density, or too irregular This regularisation can be done in purely local fashion, by randomly 
selecting vertex neighbourhoods to create the partition (see e.g. M9'i ), and this can be used to create a 
local modification rule to repair corrupted triangle-free graphs. 

1.2 General setup 

The prior results were restricted to properties for uniform monochromatic undirected graphs or hypergraphs 
without loops. We now generalise much of the above discussion to a more general setting which allows for 
the hypergraphs to be non-uniform, directed, multi-coloured, and/or contain loops. As such, there will be 
some overlap between the discussion here and that in the preceding section. 

Definition 1.10 (Vertex sets). A vertex set is any set which is at most countable. IfV and W are vertex 
sets, we define a morphism/rom W to V to be an injective map (j) : W V, and use Inj(W, V) to denote 
the space of such morphisms. We use idy G Inj(V, V) to denote the identity map from V to itself, and if 
W G V, we use iwcv G V) to denote the inclusion map. If N is a non-negative integer, we use 

[N] := {1, . . . , N} to denote the vertex set of integers from 1 to N. Ifvi, . . . , vn are distinct vertices ofV, 
we use [vi, . . . ,vn) S V) to denote the morphism that sends i to Vifor all i S [N] (in particular, 

we canonically embed Inj([Af], V) in , and the unique element q/lnj([0], V) is denoted {)). IfV is a 
set, we use \ V\ to denote the cardinality ofV, and for any k > we let 



denote the k-element subsets ofV. IfV,W are vertex sets, we use V :— {V x {0}) U {W x {1}) to 
denote the disjoint union of V and W. We often abuse notation and view V and W as subsets o/ V l+l W. 




{e C y : |eH A;} = Inj([fc], y)/Inj([fc], [fc]) 
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If<j)i€ Inj(Wi, Vi) and 02 G Inj(VF2, ^2), we use (/>i © 02 G Inj(Wi 1+1 1^2 , Vi l+l 1^2 ) to denote the direct 
sum of and 02- 

Remark 1.11. One can view the collection of all vertex sets and their morphisms as a category. We will 
make this category-theoretic perspective more explicit later in our analysis, as it contains a number of 
useful notions for us, most notably that of a natural transformation. However, readers who are not familiar 
with category theory can safely skip all remarks in this introductory section referring to this subject. 

Definition 1.12 (Palettes). A finite palette is a sequence K = {Kj)JLf^ of finite non-empty sets, all but 
finitely many of which are singleton sets. We refer to the singleton components as points and denote them 
by pt. We define the order of K to be the greatest integer k for which is not a point (or —1 if all 
components are points). We shall often abbreviate K as (Kq, . . . , Kk) (thus discarding the trivial palettes 
Kj = pt /or j > k). For any k > 0, we define the monochromatic palette {0, l}fc of order k to be the 
palette whose /c*'' component is {0, 1} and all other components are points. If j G Z, we let K<j (resp. 
K^j, K>j, Kyj, K^j) be the palette whose i'^ component is Ki when i < j (resp. i < j, i > j, i > j, 
i ~ j), and is pt otherwise, thus for instance K ~ K>q ~ _ftr>_i. 

Definition 1.13 (Hypergraphs). If V is a vertex set, we define a -coloured (directed) hypergraph to be a 

tuple G = {Gj)j°^Q, where each Gj : Inj([j], V) — > Kj is a function. (Note that Gj will be trivial when 
Kj is a point, and so only finitely many of the Gj are of any interest. We will often abuse notation slightly 
by omitting the trivial components Gj of a hypergraph.) We let 

K(v) ^ -Q^injCbiy) 

denote the collection of all K -coloured hypergraphs on V. We say that the hypergraph is undirected if we 
have the symmetry property Gj{4>o a) = Gj{(j)) for all j > 0, all a € Inj ( [j] , [j] ), and all (p ^ Inj ( [j] , V ). 
If(j) e Inj(VK, V) is a morphism between vertex sets, we define the pullbackmap 

defining K^'t'\G)j{^) := Gj((l) o 4,) for all G ^ (Gj)°^o ^ K^^^' 3 > 0' G Inj([j],W^). If W is a 

subset ofV, we write G [w for if^'wcv) (jjy refer to G [w as the restriction of G to W. 

Example 1.14. An ordinary undirected graph G — (V, E), where E C (^) can be viewed as an undirected 
{0, l}2-coloured hypergraph; similarly, a k-uniform hypergraph can be viewed as an undirected {0, l}fc- 
coloured hypergraph. In particular, 2(2) is nothing more than the hypergraphs in {0, Ijj^^ which are 
undirected. More generally, if G = (G'j)°^Q € X^^^ is undirected, then the maps Gj : Inj([j],t^) 
Kj can be viewed instead as maps from (^"j to Kj. A bipartite graph can be viewed as an undirected 
(pt, {0, 1}, {0, l})-coloured hypergraph, in which the order 1 palette {0, 1} is used for the vertex partition, 
and the order 2 palette {0, 1} is used to describe the edges of the graph. One can similarly view partite 
hypergraphs using this framework; see also Definition U .42\ below. Later on we will need to generalise the 
notion of a palette to allow the palettes Kj to be sub-Cantor spaces instead of finite sets; see Definition 

Ei] 

Remark 1.15. In the language of category theory, one can view the palette K as a contravariant functor 

V K^'^\ (j) ^ K'^'^^ between the category of vertex sets V (whose morphisms are the injective maps 
(f) : W —> V), and the category of sub-Cantor spaces (see Definition \3. l\ below), whose morphisms are the 
continuous maps ( and more generally, the probability kernels, see Appendix EI- This category-theoretic 
language seems to be a natural framework to phrase many of our notions, such as local repairability, as 
we shall see in later sections. 

Definition 1.16 (Hereditary hypergraph properties). Let K — {Kj)'j±Q be a finite palette. A hereditary 
if-property is an assignment V : V i— > 7"^^^ of a collection 7^(^) c K^^"^ of K -coloured hypergraphs on 
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V for ever^finite vertex set V, such that 

ifW(p(^))cpW (2) 

for every morphism (j) € Inj(M^, V) between finite vertex sets. In particular, the K -property V is invariant 
under hypergraph isomorphism and preserved under hypergraph restrictiot^ We say that the K-property 

V is undirected ifV^^^ consists entirely of undirected hypergraphs for each vertex set V. We extend V to 
countably infinite vertex sets V by declaring 

T'f^) := {G e : G [we V^^'' for all finite W C V}. 

We say that a hypergraph G G if obeys VifGe V^'^\ 

Examples 1.17. In the case of {0, l}2-coloured hypergraphs (i.e. graphs), the properties of being undi- 
rected and connected, of being bipartite, of being undirected and free of triangles, of being planar, and of 
being four-colourable, are all hereditary {0, l}2-properties. 

Definition 1.18 (Testability). 133] Let K be a finite palette of some order k > 0, and let V be a hereditary 
K-property. We say that V is testable with one-sided error if, for every e > 0, there exists an integer N > 1 
and a real number S > with the following property: if G € K'^^^ is a K-coloured hypergraph with 
N < \V\ < oo which locally almost obeys V in the sense that 

-4^,\{W e Q : G [we r^'^m >1~S, (3) 



then there exists G' € 7^(^) which is close to G in the sense that 



^ -\{We (^) -.Giw^G' iw}\<e. (4) 



This definition of course generalises Definition ! 1.21 

We can now state the main results of Alon-Shapira and Rodl-Schacht again: 

Theorem 1.4 (Every hereditary undirected hypergraph property is testable). H30]l If k > 0, then every 
hereditary undirected {0, l}k-property is testable with one-sided error 

Remark 1.19. See [6] for further discussion of this result, and why it is natural to restrict attention to 
hereditary properties. The cases fc = 0, 1 of this result are easy. In the case of graphs k = 2, this result 
was first obtained by after building upon several earlier results in this direction; see l[12]l , l^, ^ 
and the references therein. For general k, this result was first obtained in [30], with several earlier results 
in this direction in l[14\l . I[29]l . i l2QI/ . 4251/ . The special case of the above theorem in which V is the 
{0, l}k-property of not containing any embedded copy of a fixed hypergraph is known as the hypergraph 
removal lemma and is already a non-trivial result, implying for instance the multidimensional Szemeredi 
theorem; see Iil4\l . I[29\l for further discussion. 

^Technically, the class of finite vertex sets is not itself a set, and so P is a class function rather than a function. If one wishes to 
work with actual functions, one restricting attention to vertex sets which are (for instance) subsets of the integers. As this issue does 
not make any actual impact on our arguments, we shall henceforth ignore it. 

''in category-theoretic language, one can view V (like K) as a contravariant functor, in which : 'p{^) — > pC^) is the 

restriction of the pullback map /f''*' to T-"'^' for any injection (f> : W V; see Example l3.10l 
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The Alon-Shapira argument fE\ that gave the k = 2 case was somewhat intricate, using the Szemeredi 
regularity lemma three times and also using Ramsey's theorem for graphs. The Rodl-Schacht argument 
ll30l . in contrast, avoided Ramsey's theorem and used fewer applications of the (hypergraph) regularity 
lemma, leading to a simpler proof (though of course the fact that it dealt with general k rather than k = 2 
lead to several notational complications). On the other hand, the Rodl-Schacht argument was more indirect 
than the Alon-Shapira one and did not yield explicitly quantitative bounds. One of the purposes of this 
paper is to explain why this difference is in fact essential: the Alon-Shapira argument cannot extend to the 
case of general hypergraphs, for reasons which we shall explain below. 

1.3 New positive results 

In this paper we explore some generalisations and refinements of the above theorem, as well as counterex- 
amples to some of these extensions. Some obvious generalisations include that of allowing more general 
palettes K, allowing directed edges, allowing loops, and replacing the finite vertex set V with a more gen- 
eral probability space such as [0, 1] with uniform measure. Another direction to pursue is to determine the 
relationship between the original hypergraph G in the above theorems and the "repaired" hypergraph G'. 
For instance, the argument in 16 ] gives an effective procedure to locate G' (albeit one which requires heavy 
use of the regularity lemma); in contrast, the argument in |30 | is indirect (proceeding by contradiction) and 
does not obviously provide any algorithm for locating G' other than brute force search. 

In the positive direction we have three main results. The first result extends Theorem II. 41 to the directed 
multicoloured case: 

Theorem 1.5 (Every hereditary directed hypergraph property is testable). Let K be a finite palette, and let 
V be a hereditary K -property. Then V is testable with one-sided error. 

The proof of Theorem I 1.51 follows the Rodl-Schacht argument and is given in Section[3] 

Remark 1.20. As is well known, one can identify a directed graph with an undirected bipartite graph on 
twice as many vertices, and similar identifications also exist for hypergraphs. However, it does not appear 
possible to use such identifications to deduce the testability of directed hypergraph properties from the 
testability of undirected hypergraph properties, because one cannot canonically recover the directed graph 
from the undirected one without knowledge of the specific identification used. Indeed, the negative result 
in Theorem U .9\ below shows that the directed and undirected cases are in fact quite different. On the other 
hand, this distinction between directed and undirected hypergraphs disappears for partite properties; see 
Remark \L44\ 

The next result extends Theorem 1 1.41 (in the graph case k — 2) in a. different direction, namely showing 
that hereditary undirected graph properties are not only testable with one-sided error, but enjoy the stronger 
property of being locally repairable. Roughly speaking, local repairability (which is somewhat analogous 
to the concept of local correctability in coding theory) shows that the repaired graph G' can be (proba- 
bilistically) obtained from G in a "local" manner, in that every edge of G' can be determined using only 
knowledge of 0(1) edges of G. Because of this locality, the testability theorem can in fact be extended 
from finite graphs G to infinite graphs G (with a probability measure on the vertices), and also one can 
allow the graphs to contain loops. In fact this turns out to be a natural setting in which to study a certain 
strong form of local repairability. 

To make this more precise we need more definitions, beginning with a continuous analogue of a graph or 
hypergraph. 
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Definition 1.21 (Continuous hypergraphs). Let K be a finite palette. A i^-coloured continuous hypergraph 

is a quadruplet G — {V,B, v, (Gj)°^Q), where {V,B, v) is a probability space, and Gj : Kj is a 

measurable map for each j>O.IfW is an vertex set, we define the sampling map g'^ ^ : xC^) 
by the formula 

G^'^\v)j{cf>) = G,{vo(j>) 

for all j > 0, all (j> g Iiij([j], W), and all v € V^, where we view v as a function from W to V (and 

identify with V^^ ). IfV is a K-property, we say that G obeys V ifG''^^ (v) S -P*^' for all vertex sets 
W and all v S V^. 

Example 1.22. A {0, l}2-coloured continuous hypergraph G is essentially a probability space (V, B, v), 
together with a measurable subset G2ofVx V, which can be viewed as a continuous analogue of a set 
of edges on V. In particular, if one takes V to be the unit interval [0, 1] with the standard Bo rel a-algebra 
B and Lebesgue measure v, a {0, Y\2-continuous hypergraph becomes a measurable subset G2 of the 

unit square. The sampling map G " : [0, 1]" {0, 1}2"'' then maps any n-tuple wi, . . . , t;„ g [0, 1] of 
"sampling vertices" to the directed graph ([n], E) on n vertices, with G Eifandonlyif(vi,Vj) G G2. 

Thus, if one selects a point in [0, 1]" uniformly at random, the image of this point under G^'"^^ is a randomly 
sampled graph of order nfrom the continuous graph G. Note that we do not exclude the diagonal ofV xV 
from G2, and so we allow continuous hypergraphs to contain loops. 

Remark 1.23. In the language of category theory, one can view the map G : i— > G as a natural 
transformation /rom the contravariant functor W 1— > to the contravariant functor W i— > K^^\ If G 
obeys V, then the natural transformation G factors through the inclusion natural transformation from V to 
K. 

Example 1.24. Any ordinary hypergraph G G if*-^) on a finite set V can be extended (somewhat ar- 
bitrarily) to a continuous hypergraph G, by endowing V with the discrete a-algebra B and the uniform 
probability measure v, and defining Gj : — s- Kj to be an arbitrary extension of Gj : lnj([j'],y) Kj, 
where we view Inj([j], V) as a subset ofV^ in the obvious manner One can view G as a looped version of 
the hypergraph G. Observe that if any one of these extensions G obeys a hereditary hypergraph property 
V, then G does also. The framework of continuous hypergraph also allows for placing weights on the 
vertices by adjusting the probability measure v accordingly. 

Example 1.25 (0—1 graphons). Let E C [0, 1]^ be a measurable subset of the unit square. Then the 
quadruplet G = ([0, 1], ,B, i^, where B is the Borel a-algebra on the unit interval [0, 1], v is the 
uniform measure on [0,1], and I{E) : [0,1]^ —>■ {0,1} is the indicator function of E, is a continuous 
{0, l}2-coloured hypergraph (abusing notation slightly by dropping all the trivial components Gj of the 
graph G for j 7^ 2). IfV is the {0, l}2-property of being undirected and triangle-free, then G obeys V if 
and only if E is symmetric ( thus {x,y) G E if and only if {y, x) € E) and contains no sets of the form 
{{x, y), iv, z), {z, x)}for x,y,z e [0, 1]. 

Now we generalise the local modification rules from Definition ! 1.4l to more general hypergraphs (including 
continuous ones). We give two equivalent definitions of this concept, a concrete one (resembhng Definition 
11.4b and a category-theoretic one (resembling Remark [L6l l: 

Definition 1.26 (Local modification rule, concrete definition). Let K = {Kj)j^Q be a finite palette. A 
local modification rule is a pair T — [A, T), where A is a finite vertex set, and T is a collection of maps 
Tj : ^ K'if for 0<j<k which obey the Inj([j], [j]) -equivariance condition 
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for all (p G Inj([j], [j]). Given such a rule, and given a vertex set V, we define the modification map 
j^(^) . j^iAwV) ^ j^{V) the formula 

¥^\g)j{,P) := T,- (if (''i^«*)(G) )(</>) 

for every vertex set V, all < j < k, all G ^ and all (p € Inj([j], V); the components {G)j 

for j > k are of course trivial. 

Definition 1.27 (Local modification rule, categorical definition). Let K be a finite palette. A local mod- 
ification rule is a pair T = (A, T), where A is a finite vertex set, and T is an assignment of a map 

T^^^ : _> K'^^') for every vertex set V ( where A^V denotes the disjoint union of A and V), such 

that the diagram 



(5) 



commutes for any morphism <p G Inj {W, V) between two vertex sets W, V. 

It is not difficult to see that the two definitions are equivalent. For instance, given a modification rule {A, T) 
defined by Definition [L27] the corresponding maps Tj for Definition ll.26l can be defined by the formula 

._^(b1) 

where : if'^I^l-' — > ifi'-j'-* is the projection map. In our proofs, we shall adopt a category-theoretic 

viewpoint and rely on the latter definition rather than the former However, for the purpose of understanding 
the results, the reader may safely ignore the category-theoretic definition. 

Remark 1.28. The commutative diagram (|5]l is asserting that T is a natural transformation between the 
functors V > K^'^'^'^^ andV i— > K^'^\ It is this natural transformation property that makes the repair rule 
local (and invariant under relabeling of vertices); it implies that the value of a modified edge Ty{G)j{(j)) 
for a continuous graph depends only on the edges that involve the vertices v and the vertices of (j), and 
similarly for the modified edges T^{G)j (ip) of finite graphs. 

We now use local modification rules to modify discrete and continuous hypergraphs in order to ensure (or 
entail) certain properties V. 

Definition 1.29 (Entailment and modification). Let {A, T) be a local modofication rule. We say that this 
rule entails a K-property V ifT^^^ (ii'l-^av) ■) ^ ■p(v) vertex set V. 

• If G = (y, B, I', (Gj)°^g) is a continuous K-coloured hypergraph, and v = {va)a^A € V""^ is a 
collection of vertices in a, we define the modification Ty{G) = (V, i3, j^, (G'^ )°?^g) of G to be the 
continuous K-coloured hypergraph given by the requirement that 

mcY'^^iw) = ¥'^\g^^^'^\v,w)) 

for all vertex sets W and all w € ; one can verify that this requirement uniquely defines a 
continuous K-coloured hypergraph Ty(G). Note that ifT entails V, then Ty{G) obeys V for every 
continuous K-coloured hypergraph G on a vertex set V, and any v G V^. 
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• If G = {Gj)'^Q is a K -coloured hypergraph on a vertex set V, and 4> G V), then we define 

the modification T^{G) of G to be the K -coloured hypergraph G' = (G^ )°^q on V\4){A) defined 
by the formula 

T^{G) = T^'^^^^^^^ (^(^"''i^v^c-^)) (G)), 

vvftere (/) 1+1 idy\0(^) : A\ii {V\<j){A)) V is the bijection formed by the direct sum of cj) : A </'(^) 
and the identity map 'i<3^v\ij>(A) • ^\0(^) ~^ ^\0(^)- Again, note that ifT entails V, then T^{G) 
obeys V for every K-coloured hypergraph on a vertex set V, and any (j) G Iiij (A, V). 

Example 1.30. Let K — {0, 1}2, so that K-coloured hypergraphs are just directed graphs. We define the 

local modification rule T ~ {A,T) by setting A := [1] = {1}, andsettingT \g) G K^^^ for any vertex 
set V and any directed graph G G K'-'^^^) (thus G can be identified with a map G2 : A^V A^V ^ 
{0, l}j to be the collection of all edges {v,w) G Inj([2],y) such that G2{v,w) — G2{w,\) — 1 and 

G2(v, 1) =0. In words, T (G) creates a bipartite directed graph from G by deleting all edges from 
G except those which connect a vertex V which do not have an edge to 1, to a vertex of V which does 
have an edge to 1. In particular, if V is the {0, l}2-property of being bipartite, then it is clear that T 
entails V. If G = {V, B, v, G2) is a continuous K-coloured hypergraph (ignoring the trivial components 
Go, Gi), and vi G V, then the modified continuous graph T^-^ (G) = (V, B, v, G'2) is given by requiring 
that G'2{v, w) = 1 whenever G2{v, w) — G2{w, vi) — 1 and G2{v, vi) — 0. Similarly, if G — (G2) is a 
directed graph on a vertex set V, and vi is a vertex in V, then the modified directed graph T^,-^ (G) — G'2 is 
given by requiring that G'2{v,w) = 1 whenever G2(f , w) = G2{w,vi) — 1 and G2{v,vi) — 0. 

We can now generalise Definition ! 1.71 

Definition 1.31 (Local repairability). Let K be a finite palette of some order k, and let V be a hereditary 
K-property. 



We say that V is strongly locally repairable if for every e > there exists a finite set A, an N > 0, and 
a real number S > with the following property: Whenever G — {V, B, (Gj)*^^Q) is a continuous 



K-coloured hypergraph which approximately locally obeys V in the sense tha 



■(g"^"(«)g7'([^1)) dz.[^l(«)>l-5, 



(6) 



where is the N-fold product measure of v on V^^\ then there exists a local modification rule 
T = [A^ T) that entails V, which does not significantly modify G in the sense that 



r([fe]) 



(7) 



• We say that V is weakly locally repairable if for every e > there exists a finite set A, an integer 
N > \A\ + k, and a real number 5 > Q with the following property: whenever G is a K-coloured 
hypergraph on a vertex set V with N < \V\ < 00 which approximately obeys V in the sense of Q, 
then there exists a local modification rule T ~ [A, T) and (j) G Inj(A, V) such that T^{G) obeys V, 
and which is close to G in the sense that 



1 



l^G(^\f)):T,(G) t.^G 



-W 



< e. 



(8) 



^We use 1{E) to denote the indicator of an event E, thus 1{E) = 1 when E is true and 1(E) = otherwise. 
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Example 1.32. Let V he the {0, V\2-p^operty of being a bipartite graph. The local rule in Example \1.30\ 
entails V, but is not strong enough by itself to show that V is strongly or weakly locally repairable, because 
it tends to delete far too many edges to force bipartiteness. However, one can improve this rule by enlarging 
the set A and using a rule closer to that discussed in Section UTJ\ we omit the details. 

Remark 1.33. Informally, local repairability is the assertion that if a hypergraph locally obeys V {in the 
sense that most hypergraphs of order N obtained by randomly sampling N vertices from V will obey V), 
then there is a modification rule which is guaranteed to produce a new hypergraph which obeys V, and 
which is also close to the original hypergraph in the sense that most random k-element samples of the 
two hypergraphs will agree. (Note that this implies automatically implies the same statement for random 
j -element samples for any j < k.) 

The differences between strong and weak local repairability are that for strong local repairability, one can 
handle infinite hypergraphs, as well as hypergraphs with loops; one does not need to delete any vertices 
when repairing the hypergraph; and furthermore, the local modification rule T modifies all hypergraphs 
to obey V, not just the original hypergraph G, and the repaired hypergraph is likely to stay close to G for 
most choices ofv £ V^, and not just for a single (f) G Iiij(A, V). 

Remark 1.34. Suppose that V is weakly (or strongly) locally repairable. As stated, the repair algorithm 
T appearing in the above definition depends on the hypergraph G as well as on the data V and e. With a 
bit more effort, one can show that there exists a repair algorithm T which depends only on V and e, and 
which works (with high probability) for all hypergraphs (or continuous hypergraphs) G that obey (|6]l. To 
see this, observe that as A does not depend on G, the number of possible repair algorithms T that can arise 
is bounded (for fixed V and e). Thus one can simply try all of these algorithms in turn on a large random 
portion of G and verify empirically whether any of them obey (|7]l, and then use the "winner" to then repair 
the rest of the hypergraph. We omit the details. 



We make the following simple observations: 

Proposition 1.35 (Easy implications). Let V be a K-property for some finite palette K. IfV is strongly 
locally repairable, then it is weakly locally repairable, and also testable with one-sided error 



Proof (Sketch) Let k be the order of K. To show that strong local repairability implies weak local re- 
pairability, we start with a large finite hypergraph G on at least N vertices obeying (O (for some N and 
5 to be chosen later), extend it to a continuous hypergraph G as in Example II. 241 and apply strong local 
repairability to obtain a local repair rule T — {A, T) entailing V and obeying (|7]i with e replaced by some 
slightly smaller quantity e' depending on k and e, and assuming that N and 5 were sufficiently large and 
small respectively depending on e'. If is large enough, we can use © and the pigeonhole principle to 
find 4> e Inj(A, V) C such thajl 



|y[fel| 



w e : T^G) (w) ^ G (w) 



which then implies (l8]l if is large enough and e' is sufficiently small depending on k and e. Also, since 
T entails V, T^{G) will obey V, and we are done. A similar argument gives testability with one-sided 
error, by setting G' to be the hypergraph corresponding to T^(G) (basically, by reversing Example II. 241 
and deleting all the loops); we omit the details. □ 



*Here and in the sequel we use X <^Y and Y ^ X synonymously with X = 0{Y) otY = Q(X) for non-negative X, Y; if 
the implied constant depends on some parameters, we will indicate this by appropriate subscripting. 
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Remark 1.36. It is almost true that weak local repairability implies testability with one-sided error; the 
one problem is that the hypergraph obtained by weak local repairability was forced to delete a bounded 
number of vertices. If one strengthens the notion of weak local repairability to allow T to entail V, rather 
than merely assume that T^{G) obeys V, then one can easily fix the problem by adding a bounded number 
of "dummy" vertices to G to create a slightly enlarged graph G' , so that T^{G') still obeys V and has the 
same number of vertices as G; we leave the details to the reader. On the other hand, this strengthened 
notion of weak local repairability becomes equivalent to the strong notion of local repairability, as one can 
see by viewing a continuous hypergraph as the limit of a sequence of finite hypergraphs (and using the fact 
that for fixed A, the number of possible modification rules T is finite); we omit the details. Indeed we do 
not know any example of a hereditary property which is weakly locally repairable but not strongly locally 
repairable. 

We can now quickly state our next main theorem. 

Theorem 1.6 (Every hereditary undirected graph property is locally repairable). Let K be a finite palette 
of order at most 2, and let V be a hereditary undirected K-property. Then V is strongly locally repairable 
(and hence also weakly locally repairable). 

The proof of Theorem ll.6l follows the Alon-Shapira argument and is given in Section[3] 

Remark 1.37. Theorem 17.61 implies the existence of a probabilistic algorithm that can generate each edge 
of the graph G' in Theorem U .4\ in time 0-p ,^(1) (and using O-p ^(l) queries to G), i.e. in a time bounded 
by a quantity depending onlyQ on V and e. In particular, the entire graph G' can be reconstructed in 
time Op.edV^p) (of course, one needs to query the entire graph G to do this). Similar remarks apply to 
Theorems \1.7\ \1.8\ below. 

Another way to contrast local repairability with testability is to observe that Theorem U. 6l also easily imphes 
Ramsey's theorem: 

Corollary 1.38 (Ramsey's theorem). Let K be a finite palette of order at most 2 and let n > 1. If N' is 

sufficiently large depending on K and n, then for every undirected graph G € 1^ there exists a set 

W C [N'] with \W\ = n such that the induced graph G [w& K^^^^ is monochromatic, or equivalently 
thatK'^'t'^G [w)^G iwforall(t>elni{W,W). 

Remark 1.39. Ramsey 's theorem is of course also true for palettes K of order greater than 2, but Theorem 
17.61 turns out to fail in this case, due to the failure of a generalised version of Ramsey 's theorem: see 
Theorem 17.91 below. 

Proof. Let V be the i^-property of being undirected and not containing any monochromatic induced sub- 
hypergraph on n vertices. This is clearly a hereditary TiT-property, and hence strongly locally repairable 
by Theorem 11.61 On the other hand, it is impossible for any non-empty i4'-coloured continuous graph 
G = (V, B, G2) to obey this propertjH, since if u e V" is any n-tuple with all coordinates equal then 

'We caution however that our result, which is proven by indirect means, is ineffective or non-uniform in the sense that we do not 
provide a way to exphcitly compute this bound 073,^(1) given V and e. Indeed, given the discussion in fsl, (6|, it is extremely likely 
that the bound here is uncomputahle from that data in general, even when V itself is computable; the issue seems to be related to that 
of solving various halting problems associated to V. In particular, we have a somewhat subtle distinction: for any fixed V, e, and G, 
the repair algorithm T can be described in a finite (but uncomputahle) amount of time, but we do not have an algorithm to compute 
this description from V, e. and G. 

'*For closely related reasons, it is also impossible to find a local repair rule T which entails V. 
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is a monochromatic hypergraph on n vertices. Applying Theorem 1 1.61 in the contrapositive, we 
conclude the existence of an iV > 1 and S > such that 



1 



V 



N 



{i;G V^I^l :G*"^^«) Obeys T'} 



<1-S. 



On the other hand, if G contained no induced monochromatic sub-hypergraphs on n vertices, the left-hand 
side would b^ 1 — ON,n,Ki^/\V\). The claim then follows by taking N' sufficiently large depending on 

N,n,K,S. ' ' □ 



It does not appear possible to similarly deduce Ramsey's theorem just from Theorem 1 1.41 One indirect 
piece of evidence for this claim is that the arguments in | 30 | do not invoke Ramsey-theoretic arguments 
anywhere, but are still able to obtain Theorem 1 1.41 On the other hand, the Alon-Shapira arguments used 
to prove Theorem 11.41 in the k = 2 case crucially relies on Ramsey's theorem. Similarly, our proof of 
Theorem [L6] will also invoke Corollarv ll.38l at a key juncture (see Section [34l ). The arguments used to 
prove Theorem ll.6l can also be used (after some modification) to establish local repairability of monotone 
hypergraph properties and partite hypergraph properties. More precisely, we have the following two results. 

Definition 1.40 (Monotonicity). An ordered finite palette is a finite palette K — {Kj )°^Q, together with a 
partial ordering <j on each component Kj which is a meet-semilattice, in the sense that any two elements 
Cj, c'j in Kj have a unique weeo Cj A c^; note that this is automatically a commutative and associative 
operation. 

Now let K be an ordered finite palette and V a hereditary K -property. 



• We say that V is monotone if if given any vertex set V and any K -coloured hypergraphs G € V^'^\ 
any hypergraph G' G K^^"^ with the property that G'j{(f>) < Gj{(j)) for all j > and (j) G Inj([j],y), 
will obey V. (Informally: "deleting" edges (or lowering the colour of edges) will preserve the 
property V.) 

• We say that V is weakly monotone if given any vertex set V and any K-coloured hypergraphs 
G,G' e V^^K the hypergraph G A G' G X(^) defined by (G A G')j(0) := Gj{(f>) A G^ (0)/or 
all j > and 4> € Inj([j], V), also obeys V. (Informally, the "intersection" (or color-meet) of two 
hypergraphs obeying V, continues to obey V.) 

Example 1.41. Suppose we are in the "boolean" case where K = {0, l}fe is the monochromatic finite 
palette of some order k > 0, so that a K-coloured hypergraph on a vertex set V can be identified with a 
set E C Inj([fc], V) of morphisms from [k\ to V. A hereditary K -property V is then monotone if given 
any E € Inj ( [k] , V) which obeys V, the hypergraph associated to any subset of E also obeys V. Similarly, 
V is weakly monotone if, given any two E, E' C Inj([fc], V) which obey V, the hypergraph associated to 
E n E' also obeys V. Note that any directed monotone or undirected monotone hypergraph property is 
weakly monotone. However, one can easily concoct examples of weakly monotone properties which are not 
monotone (e.g. the property of being a complete hypergraph is weakly monotone). 

Theorem 1.7 (Every weakly monotone directed hypergraph property is locally repairable). Let K be an 

ordered finite palette, and let V be a weakly monotone K-property. Then V is strongly locally repairable 
(and hence also weakly locally repairable). 

'We use subscripts on the 0() notation to indicate that the implied constants in that notation depend on the variables in the 
subscripts. 

'"We say that 2 = x A y is the meet of two elements x, y of a partially ordered set if z < x, y, and if z > z' for any z' < x,y. 
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Definition 1.42 (Partiteness). Let K be a palette of order k > 1. IfG £ is a K -coloured hypergraph, 
< J < fc, and (j) £ Inj([j], V), we say that (j) is a partite edge ofG if the map Gi : V ^ Ki is injective 
on (f>{[j]). If G,G' e i^(^), we say that G, G' are partite equivalent ifGi = G[ and if Gj{(j)) = G'j{(j)) 
for every < j < k and every partite edge (j) £ Inj([j'], V) ofG (and thus ofG'). We say that a hereditary 
K-property V is partite if it is preserved under partite equivalence, thus if G £ V^"^^ and G' is partite 
equivalent to G, then G' £ V^^\ 

Example 1.43 (Tripartite triangle-freeness). Let K be the finite palette K ;= (pt, {1,2,3}, {0, 1}) of order 
2. Thus a K -coloured graph G £ if^^^ on a vertex set V can be viewed as a vertex colouring Gi :V ^ 
{1,2, 3}, together with a set E2 C Inj([2], V) of edges. Let V be the K-property of being undirected (thus 
(v, w) £ E2 if and only if{w, v) £ E2), partite (thus {v, w) £ E2 only if Gi(v) 7^ Gi{w)), and triangle- 
free (thus there do not exist u,v,w £ V such that (u, v), (v, w), (w, u) £ £'2). With our definitions, V is 
hereditary but is not a partite K-property, because it is not preserved under partite equivalent operations, 
such as adding edges {v,w) within a single vertex colour class Gi^{{i}). However, if we define V' to 
be the K-property that G' obeys V, where G' is the K-coloured graph with the same vertex colouring 
G'l := Gi as G, and whose edge set E2 consists of those edges (u, w) £ E2for which Gi{v) ^ Gi{w), 
then V' is a hereditary partite K-property. 

Remark 1.44. In Remark \I.20\ we commented that property testing of directed hypergraph properties 
could not be easily reduced to the property testing of undirected hypergraph properties. However, in the 
case of partite properties one can canonically convert directed hypergraphs into undirected hypergraphs 
in a manner which allows one to transfer property testing results back and forth between the directed 
and undirected cases. For instance, given a bipartite directed graph G = (V, E) (so the palette here is 
(pt, {0, 1}, {0, l})j, one can lift G to an undirected bipartite (pt, {0, 1}, {0, (0, 0), (0, 1), (1, 0), (1, 1)})- 
coloured graph G', by declaring the colour of an undirected edge {vq, vi} in G', where vq and Vi are 
in the 0-vertex and l-vertex classes respectively, to be the ordered pair consisting of the colour of the 
directed edges (vq, Vi) and (vi, Vq) in G respectively (and all edges not connecting a 0-vertex to a l-vertex 
can be assigned the colour 0j. It is then not hard to see that a partite property V of directed bipartite 
graphs G can be lifted to an equivalent partite property V' on undirected bipartite graphs G' , and that 
local testability or repair results for V are equivalent to those for V'. More generally, if K is any finite 
palette and G £ K^"^"^ is a directed K-coloured hypergraph, one can create an undirected K-coloured 
hypergraph G' £ {K'Y^\ where the finite palette K' = (A'j)°^Q is defined by setting K'j :~ Kj for 
j = 0,1 and K'j (i"j(b],^fi)x^,) y W for j > 1, by setting G'j := Gj for j = 0,1, and setting 
G'j{(l)) :— {{Gio (j)oilj,Gj{4>oip)) : ip £ Inj([j], [j])} when j > 2 and (/) is a partite edge, andG'j{(f)) := 
when j > 2 and (j) is not a partite edge. Then one can identify each directed partite K-property V with a 
undirected partite K' -property V', such that G obeys V if and only ifG' obeys V'; we omit the details. 

Theorem 1.8 (Every partite hypergraph property is locally repairable). Let K be an finite palette of order 
k > I, and let V be a partite hereditary K-property. Then V is strongly locally repairable ( and hence also 
weakly locally repairable). 

Remark 1.45. A similar result to Theorem U .8\ implicitly appears in l[20]l . It is also quite likely that Theorem 
\1.7\ can be deduced from the methods in [8], although this is not done explicitly in that paper 

Theorems 11.51 11.61 11.71 and 11.81 will all be proven in Section [3] The arguments have many features in 
common (and in fact share many key propositions) and so will be proven concurrently. To do this, we 
will use a version of the hypergraph correspondence principle |38|, combined with a structure theorem 
Q for exchangeable random hypergraphs, to convert these problems into an infinitar^F*! one concerning 
the testability and repairability of certain "infinitely regular" exchangeable random hypergraphs (or more 

' ' There are a number of advantages in working in tlie infinitary framework. One is tliat there are fewer epsilons that one needs 
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precisely, for exchangeable "recipes" for producing such hypergraphs, whose palettes are sub-Cantor sets 
rather than finite sets). This conversion, which is completed in Section l372l is analogous to the exploitation 
of graph and hypergraph limits in ll27l . ifTTIl . with the infinitely regular exchangeable random hypergraphs 
being closely related to the graphons and hypergraphons from those papers. 

The (infinitary versions of) three local repairability results (Theorem ll.6lll.7l and ll.81 ) will then be deduced 
from a single "non-exchangeable" local repairability result. Proposition [3341 in Section [34l It is at this 
stage that a certain amount of Ramsey theory is needed, and assumptions such as undirectedness, mono- 
tonicity, or partiteness become crucial. On the other hand, the result in Proposition 13 .541 does not require 
any Ramsey theory, and works for arbitrary hereditary properties. 

Proposition 13. 541 as well (the infinitary version of) Theorem ll.5l is then deduced from two discretisation 
results. Propositions 13. 56l and l3. 581 which construct certain discretisation transformations from continuous 
palettes to discrete palettes that converge in certain technical senses to the identity as the discrete palette 
becomes increasingly fine. These propositions form the heart of the paper and are proven in Sections [3.61 
13.71 Proposition 13.561 which underlies the local testability result in Theorem II. 5 1 (and is also used in the 
proof of Proposition 13. 54b follows the Rodl-Schacht approach and is relatively easy, whereas Proposition 
13.581 which is needed only for the repairability results, uses the Alon-Shapira method and is significantly 
more technical due to the breakdown of independence caused by "indistinguishable" edge 

1.4 New negative results 

The above positive results are fairly unsurprising, given the prior work in this direction such as H, |[30l . 
and |[20ll . On the other hand, the following negative results seem to be somewhat more unexpected. 

Theorem 1.9 (Negative results). (a) (Directed graph properties are not locally repairable) There exists 
a hereditary {0, l}2-property which is not weakly locally repairable. 

(b) (Undirected < 3-uniform hypergraph properties are not locally repairable) There exists a hereditary 
undirected (pt, {0, 1}, {0, 1}, {0, \})-property which is not weakly locally repairable. 

(c) (Undirected Z-uniform hypergraph properties are not locally repairable) There exists a hereditary 
undirected {0, \ }z-property which is not weakly locally repairable. 

Remark 1.46. Combining this theorem with Theorem \1.5\ we see that there exist hereditary undirected 
hypergraph properties V which are testable with one-sided error, but not weakly or strongly locally re- 
pairable. Informally, what this means is that for hypergraphs G which almost obey such properties V, 
there do exist nearby hypergraphs G' which genuinely obey V, but such hypergraphs cannot be obtained 
from G by purely local modifications. We will make this more precise in Section [2] when we prove more 
refined versions ofTheorem \1.9\ 

Remark 1.47. There are analogous result^^ in the coding theory literature. For instance, in I113\I one finds 
constructions of locally testable codes which map messages of length k to strings of length k^~^°^^\ but 
such codes cannot be locally correctable due to the lower bound results in H22\l . 

to manage in the argument. Another is that one gains access to a number of useful infinitary tools, such as the Lebesgue dominated 
convergence theorem, Littlewood's principle that measurable functions are almost continuous, and the Lebesgue-Radon-Nikodym 
theorem. While each of these infinitary tools does have some sort of finitary analogue, these analogues are significantly messier to 
use (and are less well known) than their infinitary counterparts. 

'^In the setting of |6 |, this corresponds to the difficulty of repairing edges that connect a single cell in a Szemeredi partition to 
itself. Once one considers (not necessarily undirected) hypergraphs of higher order, more complicated forms of indistinguishability 
also appear 

'''We are indebted to Luca Trevisan for this remark. 
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We prove Theorem |1.9| in Section |2l For part (a), the directed graph property is actually very simpl43 - it 
is the property that a directed graph determines a total ordering on V. The theorem is thus asserting that a 
lightly corrupted total ordering on an extremely large vertex set cannot be "cleaned up" by a purely local 
algorithm. The failure in (a) can ultimately be traced back to the simple fact that directed graphs do not 
obey the Ramsey theorem (which in turn reflects the basic fact that the two directed edges connecting two 
vertices v and w may well have distinct colours). Parts (b) and (c) are derived from the counterexample in 
(a) and some ad hoc combinatorial constructions, which "encode" the property of being a directed graph as 
a < 3-uniform undirected property, and then as a 3-uniform undirected property. It is somewhat surprising 
that one has failure of local repairability in these undirected cases, since Ramsey's theorem is known to be 
true for hypergraphs. The problem is rather subtle, and lies in the fact that in the 3-uniform case, Ramsey's 
theorem fails for a certain generalisation of a hypergraph known as a hypergraphon, in which the colour 
of a given 3-uniform edge is not completely determined by its three vertices, but is also dependent on the 
colour of the (2) 2-uniform edges between those vertices, which are in turn not completely determined by 
the vertices themselves. 

Remark 1.48. In 4251/ . a positive property testing result for 3-uniform hypergraphs was proven in the case 
thatV was the {0, ly^-property of not containing a fixed hypergraph as an induced subhypergraph. This ar- 
gument relied on Ramsey theory and it seems likely that the repaired hypergraph G' given by this argument 
could be generated by a local modification rule, though we were unable to fully verify that the arguments 
in 4231/ would yield this conclusion. If this is the case, it illustrates an interesting contrast with Theorem 
\1.9\ c), in that arbitrary hereditary properties can in fact behave differently from the properties formed from 
forbidding a single hypergraph. Unsurprisingly, the counterexample for local repair of 3-uniform hyper- 
graphs can be modified to also be a counterexample for local repair of k-uniform hypergraphs for any 
fc > 3, but we will not detail this here. 
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1.6 Summary of notation 

For the readers convenience we summarise some of the key notation used in this paper. 

The cardinality of a finite set E is denoted \E\, and we write {^^ :— {e C V : |e| = j}. For any positive 
integer N, we write [N] := {1, . . . . N}. For any event E, we write T{E) for the indicator function of 
E. The injections from to are denoted Inj(l/, W). The notation X < F, F > X, X = 0{Y), 
or y = ^1{X) is used to denote X < CY for some absolute constant C; if C needs to depend on some 
additional parameters such as e, we wifl denote this by subscripting, e.g. X Y or X = Oe{Y). 

Hypergraphs and pullback maps K^'^'> are defined in Definition II. 131 Hereditary properties are defined in 
Definition 11.161 Testability is defined in Definition 11.181 and local repairability is defined in Definition 

'*This example is of course closely related to the example of the half-graph, which is a familiar counterexample to many overly 
strong assertions about graph regularity or graph property testing. 
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11.311 after introducing the notions of a continuous hypergraph fDefinition ll.21l l. a local modification rule 
(Definition ! 1 .26l or l 1 .27b . and entailment and modification (Definition 1 1.291 ). 

In Appendix IaI a number of key probabilistic concepts are defined, including the conditioning of a 

probability measure to an event of positive probability, the notion of a probability kernel P : Y X, and 
the composition of P o Q of two such kernels. 



2 Proofs of negative results 

We begin with the proofs of the various counterexamples to local repairability in Theorem ll.9l The material 
here is largely independent of those of the positive results, which will be given in Section [3] 

2.1 The counterexample for directed graphs 

In this section we construct a counterexample that will demonstrate part (a) of Theorem |1.9l In this section 
we set K :— {0, 1}2 and k := 2. Note in this case that we can identify a if-coloured hypergraph G on a 
vertex set V with a directed graph G = {V, <g), where <g is a binary relation <g'- VxV ^ {true, false} 
on V. We let V be the {0, l}2-property that <g is a total ordering, then this is clearly a hereditary K- 
property. It will suffice to show that V is not weakly locally repairable. 

In order to illustrate some of the ideas involved, let us first demonstrate the much simpler fact that V is 
not strongly locally repairable. Consider the continuous i^-coloured hypergraph G in which V is the unit 
interval [0, 1] with the Borel cr-algebra B and Lebesgue measure /i, and <g is the usual ordering relation on 
[0, 1]. Then we certainly have (|6]i; in fact we can take (5 = in this case. On the other hand, it is impossible 
to repair G to a new continuous hypergraph G' that obeys V, because if W is any finite set with at least two 

elements, then G'*^^' (v) cannot obey V whenever v has a repeated coefficent (thus — v^i for some for 
some distinct w, w' G W), since the statements w <—^w)^_^^ w' and w' <q7(»')(^) "uj would have the same 
truth value, which is inconsistent with V. Thus V is not strongly locally repairable. 

Now we disprove weak local repairability for the same property V. This counterexample will be so strong 
that the parameter e in Definition 1 1 . 3 1 1 ( and the estimate ^) will play no role whatsoever (However, we 
will take advantage of dHJ for some suitably small e when proving parts (b) and (c) of Theorem ll.9l ) 

Let A be an arbitrary finite non-empty set, let iV > be an integer, and let (5 > be an arbitrary small 
number, which we can assume to be small compared to A, N . Let tr > be an even smaller number 
(depending on these parameters) to be chosen later, and then let M be an enormous number (depending on 
all previous parameters), again to be chosen later We set := [M]. 

To prove Theorem |1.9f a), it will suffice to construct a directed graph G = {V^ <g) obeying (O for which 
there does not exist a local modification rule T — {A, T) and e Inj(A, V) such that the repaired graph 
T^{G) obeys V (note that by construction, our counterexample V can be larger than any specified size). 
Our construction will be probabilistic in nature. 

To define G, we first define an "uncorrupted" directed graph G^°^ — (V, <q[o) ) by letting <g(o)=< be the 
standard total ordering onV = [A/], thus G'*'' obeys V. Now let G = ([A/] , <g) be a corrupted version of 
G'^°-', in which for any (w, w) G Inj([2], [M]), the statements v <q w and v < w have the same truth value 
with probability 1 — a and the opposite truth value with probability a, with these events being independent 
as {v, w) varies. 
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Since the uncorrupted G^"^ obeys V, and G is a random corruption of G^"-' , it is easy to see that for each 
fixed morphism 4> e Inj([A^], V), that K^'^'>{G) will obey V with probability I - On{o-). By the first 
moment method and linearity of expectation, we conclude that (O holds with probability 1 — On,5{(^)- Let 
us now condition on the event that ^ holds. 

Now suppose for contradiction that there exists a local modification rule T = {A, T) and (f> <E Inj(^, V) 
such that the repaired graph G' = {V\(j){A), <') := T^j^iG) obeys V. 

Let us say that two distinct vertices ui , W2 G V\(j){A) am indistinguishable if the graph X*^'^*'^''!'"^-') (G) G 
^(Aa{i,2}) jjivariant under permutation of the 1 and 2 indices; more explicitly, vi , V2 are indistinguish- 
able whenever one has the symmetries 

I{vi <G a) = I{v2 <G a) 

and 

I{a <G vi) = I{a <G V2) 

for all a e A, as well as the symmetry 

I{vi <G V2) = T{V2 <G Vl)- 

Note that if an indistinguishable pair vi , V2 of vertices exists, then by Q (applied to the map from V to 
itself interchanging vi and V2) the statements vi <g' V2 and V2 <g' have the same truth value, which 
implies that G' cannot obey V, a contradiction. Thus, in order to establish Theorem I L9f a), it will suffice 
(by the probabilistic method) to show 

Lemma 2.1. Suppose M is sufficiently large (depending on N, S, a, A). Then with probability 1 — Oa(ct), 
it is true that for every (j) £ Inj {A, V), there exists at least one pair {vi , V2 ) of distinct but indistinguishable 
vertices in V\(I){A). 

Proof. Let c > be a small constant depending on A to be chosen later (actually, one can take c := 
lOO^I'^l). Let B be an arbitrary subset of V of cardinality at least cM. We assume M is large enough that 
cM > 2. Call B corrupted if there exists distinct vi,V2 £ B such that vi <g ^2 and V2 <g have the 
same truth value. Observe from construction of G for any distinct vi,V2 E V that vi <g ^2 and V2 <g vi 
have the same truth value with probability ^ a. By independence, we conclude that B will be corrupted 
with probability at least 1 — Gxp(— i7(crc^Ajf^)). On the other hand, the total number of sets B is at most 
2*^. Also, the total number of choices for can be crudely bounded by M'"^'. By the union bound, we 
conclude that with probability at least 1 — exp(— i7(crc^A/^)), every set of cardinality at least cM 

is corrupted, for all choices of (p. If M is large enough depending on A, a, we thus see that this event holds 
with probability 1 — OA{cr). 

Let us condition on the above event, and let (p € Inj {A, V) be arbitrary. Let V, 2^ denote the power set 
of A. We can then partition 

V^AU \J Vu,u' 
u,U'en 

where for each [/ e 17, Vu,u' is the set of all v € V\A such that 

U = {a e A : V <G 0(a)} and U' = {a e A : (t){a) <g v}. 

The total number of pairs (U, U') is O^i (1). Thus by the pigeonhole principle (and taking M large enough), 
we can find U, U' such that | Vy^u' I > cM, if c is sufficiently small depending on A. In particular, Vu,u' is 
corrupted and we can find distinct ui, W2 € Vu,u' such that vi <g V2 and V2 <g vi have the same truth 
value. By construction, we see that vi , V2 are indistinguishable, and the claim follows. □ 
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The proof of Theorem |1.9f a) is now complete. 
2.1.1 Further remarks 

We close this section with some further remarks about Theorem |1.9r a). Informally, the above result asserts 
that there does not exist a repair algorithm to convert a corrupted total ordering G on a large finite set into 
an exact total ordering <', in which the order relationship of two vertices vi,V2 of the set is repaired by 
inspecting the corrupted relationship between vi , V2 and a bounded number of other vertices, selected in 
advance. It is likely that this result can be strengthened to allow for a more adaptive repair algorithm in 
which the other vertices that one queries need not be selected in advance, and for which the probability of 
the algorithm successfully obtaining a total ordering is lowered to, say, 2/3 rather than 1. One should also 
be able to obtain a similar result even if the algorithm is allowed to retain a bounded amount of "memory" 
between repairing one edge and the next. However, we will not pursue such strengthenings here. 

On the other hand, once one relaxes the requirement of locality (or bounded memory), it becomes very 
easy to repair the corrupted total ordering G used in the above proof to obtain an exact total ordering <', 
while only modifying a proportion 0(e) of the edges. We sketch the details as follows. Fix e > 0, let 
A — [N'] for some large integer N', and select (p G Inj(^, V) at random. With probability 1 — Oa{S), the 
directed graph K^'^^G) is totally ordered; we condition on this event, and then without loss of generality 
(relabeling A if necessary) we may assume that the total ordering on X^"^^ (G) is the usual ordering on A. 

For each < i < N', let Vi be the set of all vertices v E V\(j>{A) such that 

{jeA:t<j<N'}^{l<j<N':v<G Hj)} 

and 

{j&A:l<j<i} = {l<j<N': <g v}; 

roughly speaking, Vi is the set of those vertices which (f>{A) "predicts" should lie in the interval between 
and + 1). 

These sets are clearly disjoint, and using the first moment method one can show that with probability 
1 — ON',e{S), these sets cover a proportion 1 — 0(e|y|) of the vertices in V. We then define the total order 
<' by declaring Vi <' vj whenever Vi E Vi,Vj E Vj, and i < j, and placing an arbitrary total ordering <' 
on each of the Vi separately, and also completing the total ordering to the complement of IJ^ Vi (these are 
the non-local components of the repair algorithm). It is not difficult to show that for S sufficiently small, 
and then M sufficiently large, that with probability 1 — Oa,6{S), this total order <' will differ from G on 
only 0{e) of the edges; we omit the details. Note that the run time of this algorithm will be linear in the 
number of edges (i.e. the run time will be 0(|y p)). 

2.2 The counterexample for undirected < 3-uniform hypergraphs 

We now prove TheoremfTWb). We fix fc = 3 and = {pt, {0, 1}, {0, 1}, {0, 1}}. Note that a iC-coloured 
undirected hypergraph G on a vertex set V can thus be viewed as a quadruplet G — {V, Ei, E2, E^), 
where i?i C F is a set of vertices, E2 C (^) is a set of undirected 2-edges, and E3 C (^) is a set of 
undirected 3-edges. The basic idea will be to "encode" the notion of a total ordering using the undirected 
data Ei,E2,Ez. 

Let us introduce the following notation. Given a X-coloured undirected hypergraph G and vertices r, h, h' G 
V, we say that 
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• 6 is G-blue if {b} e El, 

• r is G-red if {r} ^ _Ei ; 

• r G-Ukes b if r is G-red, b is G-blue, and {r, b} £ E2', 

• r G-prefers b to b' if r is G-red, 6, 5' are G-blue, r G-likes 6, and r does not G-like b; 

• r ranks {b, 6'} G-correctly if r is G-red, 6, b' are G-blue, and {r, 6, 6'} g i?3; 

• We write b >G,r b' if r either (a) G-prefers b to 6' and ranks {5, 6'} G-correctly, or (b) G-prefers b' 
to 6 and does not rank {6, 6'} G-correctly; 

• The hypergraph G is consistently orderable if there exists a total ordering >g on y such that b >g b' 
whenever r,b,b' are such that b >G,r b' . 

We let P be the -property of being undirected and consistently orderable. One easily verifies that V is a 
hereditary undirected X-coloured hypergraph property. To show Theorem II. 9f b). it suffices to show that 
V is not weakly locally repairable. 

Let e > be a small absolute constant (one could take e = for concreteness), let A be an arbitrary 
finite non-empty set, let > be an integer, and let i5 > be an arbitrary small number, which we can 
assume to be small compared to A, N. Let a > be an even smaller number (depending on these param- 
eters) to be chosen later, and then let M be an enormous number (depending on all previous parameters), 
again to be chosen later We set F := [A/]. 

To prove Theorem ll.9f b). it will suffice to construct a i^T-coloured undirected graph G = (V, Ei, E2, E^) 
obeying (|3]l, for which there does not exist a local modification rule T — {A, T) and (j) e Inj(A, V) such 
that the repaired hypergraph T^{G) obeys V and dHJ. (Again, note that by construction that V can be made 
larger than any specified number) 

As before, to define G we first define a (random) "uncorrupted" /^-coloured hypergraph 

G(°) = (F,i?f\£;f ) 

by the following construction: 

• := [M/2] (thus vertices between 1 and M /2 are G^^^-blue, and vertices between M/2 + 1 and 
M are G(°)-red); 

• i?2°'' is a random graph on V, with each edge {wi, W2} lying in E^^^ with a probability of 1/2, with 
these events being jointly independent. (Thus, a given G^°^-red vertex will G'^'^^-like a given G^°-'- 
blue vertex with a probability of 1/2, independently of all other instances of the G^^'' -like relation.) 

• i?3°^ is the set of unordered triples {r, b, b'} such that r is G(")-red, b, b' are G(°)-blue, and one of 
the following statements hold: 

(i) r GW-likesboth6and6'; 

(ii) r does not G^°-'-like either borb'; 

(iii) r G^°'' -prefers b to and b > b'. 
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Figure 1: The three types of triples (indicated by shaded triangles) which lie in . Solid lines indicate 
edges in E2 — while dashed lines indicate edges not in E2 = e'^\ The vertices on the top row are 
red, while the bottom vertices are blue; the blue points are ordered so that the larger points are on the right. 

It is not hard to verify that G'^"-' is consistently orderable (with >q{o) being the usual ordering > on [M]) 
and so obeys V. 

Next, we define the "corrupted" ii'-coloured undirected hypergraph 

G={V,E) - {V,E^,E2,E:i) 

as follows: 

• V ^ [M]; 

• Ej ~ E^^^ for j ~ 1,2 (thus, G and G^°-' have the same notions of red, blue, like, and prefer). 

• For each e £ (^), the statements e G -£3°'' and e e i?3 have the same truth value with probability 
1 — (T, and have opposite truth value with probability a, independently of each other and of the 
random graph E^\ (Thus the relations >G.r will be a slight corruption of >q(o) r-) 

Since G(°) obeys V, we can use the first moment method as in the preceding section to conclude that (|3]l 
holds with probability 1 — On,s{(^)- Let us now condition on the event that ^ holds. 

Suppose for contradiction that there exists a local modification rule T = {A, T) and a morphism (f) : A ^ V 
such that the repaired hypergraph G' = E[,E'2, E'^) := T^{G) obeys V and From ^ we 

see in particular that 

\E'^AEj\^eM^ (9) 
for j = 1, 2, 3, where A denotes the symmetric difference operator. 

Fix T, (j). Call a quadruplet (ri, r2, 61, 62) of distinct vertices in V\{4){Ay\ inconsistent (relative to T and 
(f)) if the following properties hold: 

(i) fi , r2 are both G-red and G'-red, and bi , 62 are both G-blue and G'-blue. 

(ii) ri G'-prefers 61 to &2, and r2 G' -prefers 62 to bi. 

(iii) Theundirectedhypergraphi\:('^"(''i'''2^''i^''2))(G) € K^'^'^^'^'iHsimaimntundeithemoiphismidA®i2, 1,4,3) G 
Inj(AU [4],^U [4]), where (2, 1,4,3) € Inj([4], [4]) is the permutation which switches 1 and 2, and 

also switches 3 and 4. More explicitly, for any a G ^, we have the E2 symmetries 0(a)} G 
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Figure 2: A partial depiction of an inconsistent quadruple (ri, r2, 61, 62), surrounded by a number of 
vertices (f>{a) with a G A. The connectivity between (ri, r2, 61, 62) and needs to be symmetric with 
respect to the "reflection map" id^ ©(2,1, 4, 3) which swaps ri and r2, and swaps bi and 62, but leaves the 
vertices in (f>{A) unchanged. 



E2) = I{{b2,cl){a)} e E2) andl({ri,(/)(a)} G i;2) = X({r2, (/)(a)} S E2), as well as the E3 
symmetries 

2:(W,r2,fei} e S3) -2:({ri,r2,62} e S3) 

fo2,ri} e S3) 62,^2} e S3) 

X({ri, 61, 0(a)} e S3) = X({r2, 62, 0(a)} G S3) for all a G A 
I({ri,62,0(a)} e S3) =X({r2,5i,0(a)} G S3) for all a e A 



Observe that if (ri, r2, fei, 62) are inconsistent, then from properties (iii) and Definition 1 1 .271 we conclude 
that 



By properties (i) and (ii), this implies either that 61 <g',ti ^2 and 62 <G',r2 bi are both true, or that 
b2 <G',ri hi and 61 <G',r2 ^2 are both true. But this implies that G' is not consistently orderable and thus 
does not obey V, a contradiction. Thus to conclude the proof of Theorem I 1 .9f b). it suffices to show 

Lemma 2.2. Suppose e > is sufficiently small, and M is sufficiently large (depending on N, a, A, e). 
Then with probability 1 — OA,e (c). it true that for all morphisms cj) G Inj [A^ V) and all local modification 
rules T obeying there exists at least one quadruplet (ri, 7-2, 61, 62) of inconsistent vertices in V\(j){A). 

Proof. Let c > be a small number depending on e, A to be chosen later. Recall that the 2-uniform graph 
S2 C (X) was selected to be a random graph onV ^ [A/], with edge density 1 /2. By standard arguments 
(similaJ I to that used to prove Lemma lzTT l. we thus see that if M is sufficiently large depending on c, a, 

'''In other words, one shows that jilt holds for each pair X, Y with super-exponentially high probabihty 1 — cxp(f2c{| Vp)), and 
then apphes the union bound. See also L IOJ for a proof that random graphs are regular. 



X({ri,(/.(a),0(a')}eS3) 



X({5i,0(a),0(a')}ei?3) 



X({52, 0(a), (/.(a')} G S3) for afl {a, a'} G 



X({r2, 0(a), 0(a')} G S3) for all {a, a'} G 




2:({ri, 61, 62} e S^) = X({r2, 62, bi} G S^). 
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with probability 1 — 0{<t), the graph E2 is c-regular in the sense that 

|{(a,6) e X X y : {a,6} e i?2}| = (i + 0(c))|X||r| (11) 

for all disjointX,y C y with cardinality |y| > c\V\. Let us now condition on the event that we have 
this c-regularity, and freeze E2 (and hence G^^^). 

Next, by paying a factor of A/'"*' in all future probability upper bounds, we may freeze the morphisms (p. 
The total number of possible modification rules T is clearly 0^(1), so by paying this factor as well we 
may also freeze T. 

We now freeze the set i?3\(^^g''*-'), which describes all the edges of i?3 which contain at least one vertex 
from 4){A). Now that we have frozen these edges, as well as E2 and T, we see from Definition 1 1 .271 that 
E'l and E2 are also frozen. 

The only randomness that remains after all this freezing comes from the random variables X(e e i?3 AE'g"^ ) 
for e £ (^^3*^"^^), which are jointly independent (even after all the freezing) and equal 1 with probability 
a each. From (|5]l we conclude that if e € (^) intersects (j){A) then the quantity I{e e -Eg) is now 
deterministic, whereas if e does not intersect (t){A) then the quantity I{e G E'^) depends only on the 
quantity X(e e E^IS.e'"^^) (as well as all the frozen data, of course). 

Since E[ and E'2 are frozen, we may condition on the event that (|9|l holds for j = 1,2 without difficulty. 
(We will not attempt to condition on the event that (|9|l holds for j — 3, because this creates the technical 
problem that such a conditioning will disrupt the joint independence of the events e G E^lS.Ef \ which we 
will need to exploit later.) 

Let Vr denote the set of vertices in V\4){A) which are both G-red and G"-red, and similarly let Vb denote 
the set of vertices in V\(t){A) which are both G-blue and G'-blue. From (|9]l for = 1 we have 

\VrI\Vb\>M/A (12) 

if e is small enough. 

Let i?2 C Vr X Vb be the set of all pairs (r, 6) e Vr x Vb such that {r, 6} e E'2 AiJj. From ^ for j = 2 
and ( fT2] i. we have 

\E*2\^e\VR\\VB\. (13) 
Let $1 = 2"^ be the power set of A. If Ur G VL, define Vr^Ur to be the set of all vertices r g Vr such that 

UR = {a^A:{(p{a),r}^E2}. 
Similarly, for any C/s e fi, define Vb.Ub to be the set of all 6 e Vb such that 

UB = {a&A:{4>{a),h}^E2}. 

Then we have the partitions 

Vr^ Vr,Ur\ Vb^ [j Vb,Us 

and thus 

VrXVb^ U VRMRy^VB,UB- 

UR,UB£n 
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The number of pairs {Ur, Ub) is Oa{^)- By the pigeonhole principle (first discarding all small pairs 

yR.Un ^ ^b,Ub) choose a pair ([/_r, Ub) such that 

\VR,Unl\VB,Us\^e,AM (14) 

and 

1^2* n (Ffl^t/, X VB^Un)\ « (15) 
Fix this pair [U r, Ub) (if there are multiple pairs available, choose one arbitrarily). 

By ( fTTT i and standard "counting lemma" arguments (see e.g. [10]), we see that there exist ^ | Vr^[/„ ^ IVb.c/b P 
quadruplets (ri, r2, 6i, 62) with ri, r2 G Vr^Ur and 61, 62 G Vb,Ub such that r G-prefers 61 to 62, and r2 
G-prefers 62 to 61. In view of (fTsl l. we conclude (if e is small enough) that the same assertion holds with 
"G-prefers" replaced by "G' -prefers". 

Call a quadruplet (ri, r2, 5i, ^2) admissible if it is of the above form, thus ri, r2 G Vr,Ur and 61, 62 S 
Vb.c/b such that ri G' -prefers b to &2, and r2 G'-prefers 62 to bi. From (fl4] i we thus see that there are 
3>e,A A^"* admissible quadruplets. 

From chasing all the definitions, we see that if an admissible quadruplet (ri, r2, 61, 62) obeys ( fTOl i. then 
it is inconsistent. Thus, it will suffice to upper bound the probability that no admissible quadruplet obeys 
( [Tol l for any choice of (f>. 

Since E2 and £'2 are already frozen, so are the set of admissible quadruplets (ri, r2, 61, fe2)- Observe from 
construction of E3 that for any admissible quadruplet (ri, r2, 61, 62), the probability that this quadruplet 
obev J*^ ([Tol l is i7cr,A(l), and thus the probability that it does nof obey ( fTOl l is exp(— (^^.^(l))- Furthermore, 
the events that a family of quadruplets do not obey (fTOl i will be jointly independent as long as no two 
of these quadruplets share a vertex in common (recall that we are freezing all the edges of which 
intersect (/)(A)). Since there are ^e,A M'^ admissible quadruplets, an easy greedy algorithm argument 
allows us to find 3>e.A M admissible quadruplets for which no two share three vertices in common. Thus 
the probability that no admissible quadruplet is corrupted is at most exp(— Combining this 
with our previous factors of Afl'^' and Oa(1) introduced earlier, we obtain the claim if M is sufficiently 
large. □ 

The proof of Theorem |1.9f b) is now complete. 



2.3 The counterexample for undirected 3-uniform hypergraphs 

We now adapt the methods of the previous section to prove Theorem |1.9f c). The main challenge is to find 
analogues of G'-"-' and V in the 3-uniform setting rather than the < 3-uniform setting. This will be done in 
a rather artificial and ad hoc fashion, encoding a < 3-uniform hypergraph property in a 3-uniform one. 

We fix fc = 3 and K = {0, l}^. Note that a iiT-coloured undirected hypergraph G on a vertex set V can 
thus be viewed as a pair G = {V, E), where E3 C (^) is a set of 3-edges. 

In order to motivate the property V that we will need here, we first construct the uncorrupted fC-coloured 
hypergraph G*^^-* — (V, E^^'') which will play the role of G'^*'-' in the previous section. 

Let M be a large integer. Then we define the (pt, {0, 1}, {0, 1}, {0, l})-coloured undirected hypergraph 
G*^"^ = {[M], Ef'\ E!^^^) as in the previous section. We then define the notions of "red", "blue", 

'*Note from construction that only the first two conditions in UOt are in doubt; the remaining conditions, which involve at least 
one element from <^(A), are automatic due to ri , r2 and bi , 62 lying in the same cells V/j jy^ and Vb [7^ respectively. 
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Figure 3: The various types of triples that make up E'^^\ In addition to the triples that are inherited from 
iJg"^ , one also has triples that connect three green vertices together, or else connect a green vertex to a red 
vertex that likes a blue vertex. Note that the four green vertices on the right will in fact form a tetrahedron 
(and thus be G-green), whereas any quadruple of vertices which is not entirely green cannot form such a 
tetrahedron. 

"hkes", "prefers", "ranks correctly" as before (dropping the G*^"^ prefix). We then let V :— [2M]. We 
call the vertices in [2ilf]\[M] green (thus every vertex in V is either red, blue, or green). We then define 
G(^) — (V, to be the 3-uniform graph, where i?^^' consists of all triples {x, y, z} e (^) for which 
one of the following statements are true: 

• x,y, z are all green. 

• {x, y, z} consists of a red vertex, a blue vertex, and a green vertex, and the red vertex likes the blue 
vertex. 

• {x,y,z} consists of a red vertex and two blue vertices, and the red vertex ranks the two blue vertices 
correctly. 

Note how E^^^ involves the three components e[^^ , E^^^ , E^^ of E^^'' . 

Now we define V. For any if-coloured undirected hypergraph G = (V, E), we introduce the following 
notation: 

• We call an element gi €V G-green if there exists {^2, 93, 54} e (^^3'''^) such that (i9i,g2^g3m}^ (- 
E. 

• We call an element x lE V G-nongreet^ if there exist distinct G-green vertices g, g' such that 

{x,g,9'} ^ E. 

• If a;, y £ V are distinct, we say that x G-likes y if they are both G-nongreen, and there exists a 
G-green vertex g such that {x, y, g} E E. 

• Two vertices x,x' E V are G-similar if there exists y such that a;, x' both G-like y. 

• If r, 6 e V are distinct, we say that r G-dislikes b if r,b are both G-nongreen, and there exists a 
G-green vertex g such that {x, y, g} ^ E. 

• If 6, r are distinct elements of V, we say that r G-prefers b to b' if r, b, b' is G-nongreen, 6, b' are 
G-similar, r G-likes 6, and r G-dislikes 6'. 

'^We allow for the possibility that a vertex is both G-green and G-nongreen, or is neither G-green nor G-nongreen. However, these 
situations will not occur for the model graph G^^' . 
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• If b, b', r are distinct elements of V, we write b >G.r b' if either (a) r G-prefers b to b' and {r, b, b'} G 
E; or (b) r G-prefers b' to b and {r, b, b'} ^ E. 

• The hypergraph G is consistently orderable if there exists a total ordering >g on such that b >g b' 
whenever r, 6, 5' are such that b >G,r b'. 

We say that a i^T-coloured hypergraph obeys V if it is undirected and consistently orderable. One can verify 
with some tedious effort that V is an undirected if -property. One can also verify that when G — G*^^-', the 
fj(i).g]-een vertices are precisely the green vertices, the G^^-'-nongreen vertices the red and blue vertices, 
and G^^-'-similar vertices are either both red or both blue. From this one can easily verify that G*^^^ obeys 
V (using the usual ordering > on [2M] for >q(,i))- 

We set e > to be small (e := will do). Let A, N > 0, and S > Ohe arbitrai-y, and let ct > 
be sufficiently small depending on all these parameters. We then let M be a large integer (depending 
on all previous parameters). We define the "corrupted" 3-uniform hypergraph G — (V, E) by declaring 
X(e e E) := I{e e E'^^^) with probability 1 - ct andX(e e E) := 1 -X(e e E'^^)) with probability ct for 
each e G (^) , independently for each choice of e. 

bmce G(i) obeys V, we can use the first moment method as in the preceding two sections to conclude that 
(O holds with probability 1 — On.s{(^)- Let us now condition on the event that (|3]l holds. 

To prove Theorem 11. 9f c). it will suffice to show that there does not exist a local modification rule T = 
{A, T) and a morphism (p E Inj(A, V) such that the repaired hypergraph T^{G) obeys V and 

Suppose for contradiction that T and cj) exists with the above properties. We write G' = {V\(I){A), E') := 
T^{G). From dHJ we thus have 

l-B'A^;! < eM^. (16) 

Let us call an 9-tuple 

(ri,r2,r3,6i,62,5i,52,53,g4) (17) 
of distinct vertices in V\(t){A) inconsistent if the following properties hold: 

(i) ({91>9Y3,94}) ^ ^/^ 

(ii) For a; € {ri, r2, ra, 6i, 62} we have {a;, 51, 52} ^ E' . 

(iii) Fori e {l,2,3}and j e {1, 2} we have {r,, 6^, 51} e £" if and only if (i, j) ^ {(1, 1), (2, 2)}. 

(iv) We have the symmetries (fTOl l (with £^3 replaced by i?). 

Suppose that we can locate an inconsistent 9-tuple ([TtI i. From property (i) we see that 51, (72, <?3, Qi are 
G'-green. From property (ii) we then conclude that ri, r2, ra, 61, 62 are G'-nongreen. From property (iii) 
we conclude that for i e {1, 2, 3} and j € {1, 2}, that G'-likes bj whenever ^ {(1, 1), (2, 2)}. 
In particular, bi, 62 are G'-similar (thanks to r-s). From property (iii) again we also see that ri G'-dislikes 
61 and r2 G'-dislikes 62- Thus ri G'-prefers 62 to bi, and r2 G'-prefers 61 to 62- On the other hand 
from property (iv) and Definition 11.271 as in the previous section we see that T{{ri,bi,b2} G E') = 
^{{r2,b2,bi} S E'). Thus either 61 >G',ri &2 and 62 >G',r2 bi are both true, or 62 >G'.ri and 
bi >G',r2 b2 are both true, and so G' is not consistently orderable and thus does not obey V, a contradiction. 
Thus to conclude the proof of Theorem |1.9f c), it will suffice to show 
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Lemma 2.3. Suppose e > is sufficiently small, and M > is sufficiently large (depending on 
N,S,a,A,N^,s). Then with probability 1 — OA,s,ei'^)' there will exist at least one 9-tuple ilH of in- 
consistent vertices in V\(I){A), for all choices of morphism (j) and modification rule T for which ( II6I 1 holds. 



Proof Let c > be a small number depending on e, A to be chosen later. Recall the 2-uniform random 
graph E2 on [M] used to construct G*^"^. By arguing exactly as in the proof of Lemma l272l we see (for 
M large enough) that with probability 1 — 0{a), we have the regularity property (fTTT i for all disjoint 
X,Y <Z [M] with |X|, |y| > cM. Let us condition on the event that this regularity property holds. We 
now freeze E2, which in turn freezes G'^^-' and E''^^. 

As in the proof of Lemma l2.2l we pay a factor of Oa{M^^^) in all future probabihty upper bounds in order 
to freeze and T. 

From construction, we have for any {vi, V2, W3} S (^), that {f 1, ^2, 1's} € EAE^^'' with an independent 
probability S. From Chernoff 's inequality, we conclude that for each vi,V2 G V, that 



\{V3 e V\{vi,V2} : {vi,V2,V3} e EAE'-^^I < S^/^M 



(18) 



with probability at least 1— Gxp(— fi^ (M)). For technical reasons (related to the reason we did not condition 
on ^ for J = 3 in the previous section), we will weaken (fTSI l to 



\{V3 e V\{v,,V2} : {v,,V2.V3} e {EAE^'^)\(^^'^^\^^^A}\ < S'^Hl 



(19) 



in order not to destroy the independence of the events {vi,V2,V3} G EAE^^^^ when vi,V2,V3 lie in 

[AimA). 

By the union bound, we thus see that (if M is sufficiently large) that with probability 1—0{M exp{—il,s{M))) 
1 — 0{(t), the assertion (fT9] l holds for all vi,V2 G V. We now condition on the event that this holds. 

We now freeze the restriction £'\(^[^^l\j^'-"^-') of E to those edges which are not contained in [M]\(j){A). 
Thus the only randomness remaining comes from the random variables X(e e E^^''AE)foie e 
which are jointly independent with probability 6 each. Note (from Definition IL27b that the quantity 
X(e G £") for e G ('*^') is now deterministic unless e G in which case it depends only 

on the quantity X(e G E^^^'AE) (as well as frozen data, of course). 

We would like to condition on the event that (IL27l l holds, but this would destroy the joint independence of 
the events e G E^^^'AE, which will be important later. So we shall be content to condition on the slightly 
weaker statement 

1 



{EAE') 



< £ 



(20) 



as this is a deterministic statement that does not depend on the truth value of any of the events e G AE 



foreG 



The next step is to select some good vertex sets to work with. From ( [20] l we have 



E 

vi£V\<j,{A) 



{V2,vz} G 



: {vi,V2,v-i\ G (EAE )\ 



and so (for M large enough) by Markov's inequality we can find a subset V C V\4>(A) with |V^\V^'| <C 
e^/^Af such that 



{V2,v-i} G 



(21) 
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for all vi £V'. 
Set 



Vb 
Vr 
Vg 



= [M/2] n V 

= {[M]\[M/2])nV' 
= {[2M]\[M])nV'. 



In particular (for e small enough) we have | Vb | , | ^i? | , | Vg | 3> M. 
For b E Vb and r e Vr, define 

/(r, 6) := |{« e V\{r, b} : {r, 6, v} e (£;Ai?')\ }|, (22) 

thus < /(r, 6) <C M. From (fTSI l we observe that 

E E /(r-,6)«e|Vij||Vs|M. 

Thus if we define 

E* := {(r, 6) e Vfl X Vb : f{r, b) > ^M} (23) 
then by Markov's inequality we have 

\e;\ <t: V^\Vr\\Vb\. (24) 

Let riR := 2(2) and 17s := S^s^) be the power sets of (2) and (^2) ■= Uj<2 (f) respectively. If 
Ur G flR, define V/j^c/h to be the set of all vertices r & Vr such that 



Ur = {{a, a'} e (^2) • {<^(«)' -^(a')' ^} ^ i^s}. 



Similarly, for any Ub G fis, define Vb,Ub to be the set of all b e Vb such that 

Ub = {{a} e(^^y.b< 0(a)} U {{a, a'} G l^^) ^ {'^(a), e ii;2}. 

The Vr^Uh ™d ^b,Ub paitition Vr and Vs respectively. Since \^r\, \i^B\ 1, we thus see from (|24] | 
and the pigeonhole principle that there exists Ur E Ur, and J/^ e with 

|Vfl,c/„|,|VB,c/,|»^M (25) 

and 

\E*2 n (V,j,c/H X Vb,Us)\ « Vi|VB,c/J|V;?,a^|. (26) 
Henceforth we fix C/s and [//j so that ( IZSl l. ( |26] l hold. 



To locate inconsistent 9-tuples (fTTI i we shall constructed a nested sequence Eq D . . . D S7 of candidate 
9-tuples as follows. We let Sq be the collection of all 9-tuples ( fTTT i such that {ri,r2,rs} e (^"3^"), 

{^1,62} G TY")' and {51,52,53,54} 6 Clearly we have |I]o| » |Vfl,,y, |3|Vb,[/J'M". 

Let Si be the collection of all 9-tuples ( [TtT i in Eg such that for all i G {1, 2, 3} and j E {1, 2}, we have 
{fi, 6j } G i?2 if and only if (i, j) ^ {(1, 1), (2, 2)}. Using (fTTT i and standard "counting lemma" arguments 
we see thatif cis sufficiently small (depending on A^'). then |Ei| :$> \Vr,Uj,\'^\Vb.Ub\'^^^'^- 
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Let E2 be the collection of all 9-tuples (Tj} in Ei such that (n^bj) ^ for all i G {1, 2, 3} and j G 
{1,2}. From ^ we have |Ei\E2| < Ve\VR.Ua\^\VB,UB\'^M'^- Thus if e is sufficiently small we have 

\^2\:>\Vr,uJ^\Vb,us\^m\ 

Let E3 be the collection of all 9-tuples ^IT^ in E2 such that {r^, bj,gk} ^ EAE' for all i e {1, 2, 3}, 
j e {1,2} andfc e {1,2,3,4}. From (|22li, (|23l) we see that |S2\E3| < PI Vb,c/b pA^*- Thus if 

£ is sufficiently small we have IS3I > \Vr,Ur\^\Vb,Ub I'^M'^. 

Let E4 be the collection of all 9-tuples ( fTTI l in E3 such that {x, y, z} ^ EAE' for all x G {ri,r2, r^, hi, 62} 
and distinct y,z G {gi, 92, 33, 94}- From (1211 1 we see that |E3\E4| ^ -s/ej Vr,[/„ |^| Vg^;/^ pM^. Thus if e 
is sufficiently small we have IE4I > IVrmrI^IVb^UbI'^ M^. 

Let E5 be the collection of all 9-tuples (fTTl i in E4 such that {a;, y, z} ^ EAE' for all {x, y, z} G 
(-{31,92,33,34}^^ From (EOll we observe that |E4\E5| < e\VR^UR\^\VB,UB\^M^- Thus if e is sufficiently 
small we have IE5I > \Vr,Ur\^\Vb^Ub?M'^- In particular, by dSj we have IE5I >a M^. 

Let Ee be the collection of all 9-tuples ^j} in E5 such that {x, y, z} ^ EAE^'^'> for all 

r . ^ /{''i,?'2,r-3,6i,62,5i,52,53,54}U0(A)V /{ri,r2,6i,52}\\ 

From (fTsT i we see that |E5\E6| S^^^M^. Thus if 6 is sufficiently small (depending on N') then 

ISel »A M9. 

Let E7 be the collection of all 9-tuples ( fTTI l in Eg such that 

I{{ri,bi,b2} G E)=I{{r2,bi,b2} G E) and X({6i, n, r2} G = X({fe2, ri, r2} G E) 

To estimate the size of E7 we will need a slightly different type of argument than those used in previous 
paragraphs, namely a probabilistic argument. Let Inj([9], [2Af]) denote the space of all 9-tuples (fTTT i. 
From the lower bound jEgl A/^ we see that for each fixed n, a randomly selected 9-tuple ( fTTI l in 
Inj([9], [2M]) would he in Eg with probability >^ 1. 

Now observe from construction of Eg and E that the event that (fTTt lies in Eg is independent of the events 
{x,y,z} G EAE^^) for{a;,?;,z} G (^i^'-^^^i^''^}), which each occur with an independent probability of 
5. Thus, regardless of the truth values of {x, y, z} G E^^^ for {x, y, z} G (^^'^^^^^^^^''^^'^^ we see that if 
one conditions on the event ( fTTI l lies in Eg, then ( fTTI l will lie in E7 with probability ^5 1. Undoing the 
conditioning on Eg, we see that a randomly chosen 9-tuple (fTTt in Inj ( [9] , [2 Af ] ) lies in E7 with probability 
1- 

Let A :— [A/°-^J . We pick A 9-tuples ti, . . . ,tA G Inj([9], [2M]) independently at random (and indepen- 
dently of E2 and E). With probability 1 — 0(A/^°^), these tuples will be disjoint; we condition on this 
event. Now we make the crucial observation the events ti G E7 are jointly independent for i = 1, . . . ,A. 
Indeed, in view of all the frozen data, the event that ti lies in E7 depends only on the truth value of the 
events {x, y, z} G {EAE^^^)n (j-^^^'^^^^^'j ^ where {a;, y, z} lies ti, and the independence assertion follows. 
(It is for this reason that we have jealously guarded the joint independence of the edge events associated to 

^[M]\4,{A)yy 

Now for any 1 < i < A, if we condition on ii, . . . , then each ti will lie in E7 with probability ^s.n' 1 
(the constraint that ti, . . . , i^i are all disjoint only distorts this probability by 0(M~°^), which is negligible 
if M is large enough). Multiplying this together we see that with probability at least l — exp{ils^N' (-Af°'^)), 



'*Note how it is important here that ^ '^^3''^ '*2 }^ jg excluded in j27t . 
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at least one of the ti will lie in E7. Unfreezing (j) and T, we conclude from the union bound that with 
probability 1 - OA,siM\'^\ exp{ns,A{M°-'^))), we have E7 non-empty for all choices of 4){A) and T. In 
particular, this event occurs with probability 1 — 0(cr) if A/ is large enough. 

To conclude the lemma, it will suffice to show that every 9-tuple in E7 is inconsistent. Let ([TtI i be a tuple 
in S7. By definition of Eq, we have gi, 32, 53, 54 G Vc, and thus by definition of 



definition of Eg we then have {x, 51, .92} ^ -E, and by definition of E4 we have {x, 51, 52} ^ -E'. This is 
part (ii) of the definition of inconsistency. 

From the definition of Eq, gi is green. From the definitions of Ei and E^^'' we then have for every 
i e {l,2,3}and j e {1, 2} that {r„ 5j, .gi} e E^^^ if and only if ^ {(1, 1), (2, 2)}. By definition of 
Eg, the same statement holds with E'-^^ replaced by E, and by definition of E2 the same statement holds 
with E replaced by E'. This is part (iii) of the definition of inconsistency. 

It remains to verify (fTOl i (with E^ replaced by E). The first two symmetries follow from the definition of 
E7. The last two symmetries follow from the definitions of Eq and Vr^Ur^ Vb,Ub- To verify the middle 
two symmetries, we see from definition of E3 that it suffices to show that I{{ri, bi, 0(a)} e E^^'') = 
I{{r2,b2,(t>{a)} e andl({ri,&2,'/'(a)} G E^^'^) = X({r2, 61, 0(a)} G E^^'^) for all a G A. 

Fix a. There are several cases. If 0(a) is green, then the claim follows from the definitions of i?^^^ 
and El. If 0(a) is red, then by definition of E^^\ none of the {rj, bk, 0(a)} lie in E'^^\ and the claim 
follows. Finally, suppose that 0(a) is blue. By definition of Vb.Ub ^^'^ Vr,Ur^ we see that T{bi < 
(l>{a)) —I{b2 < 0(a)) and X((ri, 0(a)) g E2) =I((r2,0(a)) € -£2)- Also, by definition of Ei we have 
X((ri,6i) e E2) =X((r2,&2) e E2) andX((ri,62) e ^^2) =I((r2,fei) G E2). The claim then follows 
from the definition of i?*^^^ □ 

This concludes the proof of Theorem ll.gf c). 

Remark 2.4. One does not need the full strength of consistent orderability to define V; it is enough that 
there do not exist r, r', 6, b' such that b >G,r b' and b' >G.r' b. With this modification, the property V can 
now be expressed as a single first-order sentenc^^ using only the universal quantifier V, which is a slightly 
stronger statement than saying that V is hereditary. This gives a slight strengthening to Theorem \1.9\ c). 

"Equivalently, there exists a finite collection of "forbidden" hypergraphs which describe V, in the sense that G obeys V if and 
only if it contains no induced copy of any of the forbidden hypergraphs. In contrast, hereditary properties are associated to an at most 
countable family of forbidden hypergraphs. 




From the definition of Eg we thus have 



{51,52,53,54} 




and then by definition of E5 we have 
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3 Proofs of the positive results 



We now begin the proofs of the positive results. Except in side remarks and examples, the material here is 
independent of that in Section |2l 

3.1 An infinitary setting: exchangeable random hypergraphs and their structure 

In order to prove our new positive results, it will be helpful to recast the graphs and hypergraphs that we 
are studying into a more infinitary form (although the actual arguments will still be structured much as in 
the finitary presentations in Alon and Shapira |5| and elsewhere). The formalism we will use is that of 'ex- 
changeable random hypergraphs', which have already appeared in the study of single hypergraph removal 
lemmas in 1381 and whose structure is examined in more detail in |7 |. In addition to providing a reasonably 
clean language for handling continuous graphs, these also admit their own versions of the theorem we shall 
prove, in whose statement the existence of an e-modification of a given graph or hypergraph to another that 
satisfies a certain property is replaced by that of a near-diagonal joining of a given exchangeable random 
graph or hypergraph to another that satisfies the relevant property almost surely. 

The infinitary setting offers several advantages. Firstly, it conceals from view many quantitative parameters 
such as e and N which would otherwise have to be managed directly by hand; the process of taking a limit 
sends most (though not all) of these parameters to zero or infinity, and the remaining parameters often just 
need to be controlled qualitatively (e.g. knowing that they are finite) rather than quantitatively (i.e. with 
an explicit bound). Secondly, it allows one to use the standard tools and intuition from basic infinitary 
theories, most notably topology, measure theory, and probability theory. For instance, the well-known fact 
that measurable functions can be approximated by continuous ones will form a partial substitute for the 
Szemeredi regularity lemma. 

The purpose of this section is to review the relevant theory from fT^ which we will need here. To begin 
with we shall work with undirected graphs, and then discuss the (minor) modifications needed to handle 
directed graphs later in this section. 

3.1.1 The category of sub-Cantor spaces 

Our infinitary analysis will take place in the category of sub-Cantor spaces, which we now pause to define. 

Definition 3.1 (Sub-Cantor spaces). A sub-Cantor space is a topological space Z which is homeomorphic 
to a compact subset of the standard Cantor space {0, 1}^. We always endow sub-Cantor spaces with their 
Borel a-algebra generated by the open sets ( or compact sets). We say that a sub-Cantor space is trivial or 
a point if Z is a singleton set, and write Z ~ pt in this case. 

Examples 3.2. Any finite set is a sub-Cantor space, a closed subspace of a sub-Cantor space is again a 
sub-Cantor space, and any at most countable product of a sub-Cantor space is again a sub-Cantor space. 
In particular, K^^^ is a sub-Cantor space for any finite palette K and any vertex set V. 

Remark 3.3. By a theorem of Borel, a space is a sub-Cantor space if and only if it is totally disconnected, 
compact, and metrisable. However, we will not need that characterisation here. We also make the useful 
observation that the topology of a sub-Cantor space can be generated from a countable algebra of clopen 
sets, as this property can be easily verified for the Cantor space {0, l}'^ and is preserved under passage to 
compact subspaces. 
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We will view the class of sub-Cantor spaces as a category, where the morphisms are the probability kernels 
P : X ^ Y between sub-Cantor spaces X,Y; see Appendix lAl for a definition of a probability kernel 
and their relevant properties. (This is distinct from the category of vertex sets, defined in Definitio dLlOl ) 
Informally, one can think of a probability kernel as a stochastic analogue of a function from X to Y, 
mapping points in X to probability distribtions in Y rather than to deterministic points. We distinguish 
several special types of probability kernels between sub-Cantor spaces: 

• A probability kernel P : X ^ Y \s deterministic if we have P{x) — for a\\ x £ X and some 
measurable (f) : X ^Y\ 

• A probability kernel P : X ^ F is deterministically continuous if we have P{x) = i50(a;) for all 
X £ X and some continuous (f) : X ^Y; 

• A probability kernel P : X Y is, weakly continuous if the function x ^ jy fiu) P{^id,y) is 
continuous for every continuous function f : Y ^ R. 

Remark 3.4. Recall from Remark \3.3\ that a sub-Cantor space has a countable base of clopen sets. Because 
of this, one can easily verify that a probabilistic kernel is deterministically continuous if and only if it 
is both deterministic and weakly continuous. As we will show later (see Proposition \3.45\ and Definition 
13.471 ), the concept of weak continuity will correspond to testability with one-sided error, while deterministic 
continuity will correspond to strong local repairability. Roughly speaking, weak continuity is the minimal 
amount of regularity necessary for one to be able to transfer infinitary results back to the finitary setting, 
while strong continuity, in view of the sub-Cantor structure, means that the relevant continuous maps 
(j) : X Y between sub-Cantor spaces "depend on only finitely many coordinates" and will thus define a 
local modification rule. 

Rather than work on an individual sub-Cantor space, it will be useful to conduct our analysis on families 
of sub-Cantor spaces indexed by vertex sets, with various morphisms between these spaces. The most 
convenient way to handle these families is via the notion of a contravariant functor from category theory. 

Definition 3.5 (Contravariant functor). A contravariant functor Z is an assignment of a sub-Cantor space 
Z^'^'^ to every vertex set V, together with a probability kernel Z*^*^) : Z'^^ ^(W') for every morphisn^ 
4> & Inj(T/F, V) between vertex sets, such that Z'^"^^^ : Z'^^ Z'^^^ is the identity probability kernel on 
Z'^^^ for every vertex sets V, and such that Z^'^°'^'> = Z'^^^ o Z^"^^ for any morphisms S Inj (VF, V) and 
ip G Inj (V, U) between vertex sets. We say that the contravariant functor is deterministically continuous 
( resp. weakly continuous) if all the probability kernels Z^'^-' are deterministically continuous ( resp. weakly 
continuous). If z £ Z^^^ and W G V, we write z [w& Z^^-* for Z^''"^'^^\z), and refer to z [w as the 
restriction ofz to W. Similarly, if ^ e Pr(Z*^^)) and W d V, we write fi [w& PT{Z^^^ )for the projected 
measure Z'''^'^'^ o fi. 

If Z is a contravariant functor and S is a vertex set, we define the shift Z^^ to be the contravariant functor 
given by requiring that 

for all vertex sets V and 

for all morphisms (j). One easily verifies that Z*"^ is a contravariant functor, which is deterministically 
continuous (resp. weakly continuous) if Z is. 

^"Recall that in the category of vertex sets (as opposed to that of sub-Cantor spaces), the morphisms are just the (deterministic) 
injective maps between vertex sets. 
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Remark 3.6. Intuitively, a contravariant functor is a recipe for generating a space of objects Z^^^ to every 
vertex set V, to which one can meaningfully perform operations such as relabeling V, or restricting V to a 
subset W. A typical example of such a space Z*^^^ would be K^^\ the space of K -coloured hypergraphs 
on V. Note however that we allow the relabeling and restriction operations to be stochastic rather than 
deterministic. 

In this paper we will only be dealing with either deterministically continuous or weakly continuous con- 
travariant functors. One such functor is the trivial functor pt, which maps every vertex set to a point (and 
every morphism to the unique probability kernel between two points). More generally, an important source 
of such functors for us will come from sub-Cantor palettes. 

Definition 3.7 (Sub-Cantor palettes). A sub-Cantor palette is a tuple Z = (Zj)°^q of sub-Cantor spaces, 
all but finitely many of which are trivial. We define the order of Z to be the largest k for which Zk is 
non-trivial, or —1 if all components Zj are trivial. We identify Z with a deterministically continuous 
contravariant functor by defining 

oo 

^{V) "Q ^Inj(b"],V) 
3=0 

for all vertex sets V, and defining Z*^*^' : Z^^^ — > Z^^' for all morphisms <j) & Inj {W, V) by the formula 

for all ((2j('(/;))^ginj([j],y))j^o ^ Z'-'^K One easily verifies that Z is indeed a deterministically continuous 
contravariant functor 

Ifj is an integer, we write Z<:j ( resp. Z^j, Z^j, Zyj, Z^j)for the sub-Cantor palette whose i"^ component 
is Zi when i < j ( resp. i < j, i > j, i > j, i = j) and a point otherwise. 

Example 3.8. The finite palettes in Definition \1.13\ are sub-Cantor palettes. 

Example 3.9 (Sub-Cantor spaces as contravariant functors). A sub-Cantor space X can be viewed as a 
sub-Cantor palette of order 0, andean therefore be viewed as a contravariant functor, in which X^^-* = X 
and X*^*^^ = idx for all vertex sets V and morphisms (f>. 

Example 3.10 (Hypergraph properties as contravariant functors). IfK is a finite palette and V is a hered- 
itary K-property, one easily verifies for every vertex set V that T'^^) is a closed subspace of K^^^ and is 
therefore itself a sub-Cantor space. From this and the hereditary nature ofV we see that V is in fact a 
contravariant functor. 

We will also need to deal with families of probability kernels between one family of sub-Cantor spaces and 
another. The most convenient way to handle such a concept is using the notion of a natural transformation 
from category theory. 

Definition 3.11 (Natural transformation). A natural transformation N : Z between two contravariant 
functors Z, Y is an assignment of a probability kernel iV^^^ : Z'^^ ^ y(^) fior every vertex set V, such 
that the diagram 
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commutes for every morphism <f> G Inj(W, V) between vertex sets ( the horizontal arrows here being prob- 
ability kernels rather than continuous maps). We say that the natural transformation is deterministically 
continuous (resp. weakly continuous) if all the probability kernels N'^^^ are deterministically continuous 
(resp. weakly continuous). 

An exchangeable Z-recipe on a contravariant functor Z is a natural transformation fj, : pt Z from the 
trivial functor to Z, or equivalently an assignment of a probability measure /i^^^ € Pr(Z(^)) to every 
vertex set V, such that one has the exchangeability property 

Z(^) o ^(^) = ^C'^) (29) 

for all morphisms (p e Inj(VK, V) between two vertex sets. If S is a vertex set, we define the exchangeable 
Z'^S -recipe /i"^^ : pt ^ by the formula {p'^S)^^^ := 

Remark 3.12. The condition ( I28l l can be divided into two sub-conditions, namely equivariance (or ex- 
changeability) 

y (0) o iV(^) = iV(^) o z'-'f'^ for all e Inj {V,V) (30) 

and locahty 

N'-^^z) [w=N'^^\z iw)forallW cV and z e Z'-^K (31) 

Similarly, if n is an exchangeable Z -recipe, then fi^^"^ is an Inj(y, V)-invariant measure on Z^^\ and the 
pushforward of ji'^^^ under the restriction map to a subset W ofV is the measure fj,^^\ 

Intuitively, a natural transformation N : Z ^ Y is a rule (which may be either deterministic or stochastic) 
for converting Z-type objects on a given vertex set V to Y-type objects on the same vertex set, in a manner 
which is both local (in the sense of (I31l l) and exchangeable (in the sense of i30i ). We will shortly give a 
number of examples of natural transformations, such as recolouring maps, and local modification rules. 

If Z is a palette, one can view an exchangeable Z-recipe as a means for constructing a random Z-coloured 
hypergraph on any vertex set V, which is exchangeable with respect to relabeling of V, and also respects 
restriction from one vertex set to a subset. 

Remark 3.13. For future reference we observe the obvious fact that the composition Ni o N2 : Z ^ X of 
two natural transformations Ni : Y X and N2 : Z ^Y , defined by (N\ o '■= ^^^^ ° ^2^^ 

again a natural transformation. 

Many important combinatorial operations on hypergraphs can be interpreted as natural transformation^ 
We list some examples of relevance to our applications here. 

Definition 3.14 (Colouring as a natural transformation). Let Z — {Zj)°^Q be a sub-Cantor palette. A 
colouring a : Z ^ A of Z is a tuple a — {aj)°^Q of continuou^ mfl;?i aj : Zj Aj, where A = 
(Aj)°^Q is a finite palette. Each individual map aj can be interpreted as a deterministically continuous 
natural transformation HJ : Zj Aj defined by the formula 

a7*^^((2:(0))0einj(b],v)) (aj(2('?!>)))0Ginj([i],y) 

and then the entire colouring can be viewed as a deterministically continuous natural transformation a : 
Z ^ Aby 

-'Informally, any operation on hypergraphs which is both local (the effect of an operation on a subset W of the vertex set V 
depends only on the restriction of the hypergraph to W) and exchangeable (the operation respects hypergraph isomorphism) will have 
an interpretation as a natural transformation. 

-^Informally, this means that the colour assigned to any point in Z depends only on "finitely many coordinates" of that point. 
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One easily verifies that oij and a are indeed deterministically continuous natural transformations. We say 
that a colouring a : Z A refines or is finer than another k : Z ^ K if we have k = a o a for some 
colouring a : A ^ K. 

Example 3.15 (Probability measures as exchangeable recipes). If X is a sub-Cantor space (which we can 
view as a palette of order and thus as a contravariant functor, by Example \3. 9| ), then an exchangeable 
X-recipe fi is nothing more than just a probability measure fj, € Pr(X) on X. 

Definition 3.16 (Sampling as an exchangeable recipe). Let K — (Kj j'^^Q be a finite palette, and let 
G = (y, B, ly', {Gj)j^Q) be a continuous K -coloured hypergraph. For any vertex set S, the sampling map 

is a measurable map, and V^^^ := i'^ is a probability measure on V^. Thus the 

pushforward measure G o 77*^ ■^^ is a probability measure on K^^\ which can be viewed as a probability 
kernel from pt to K'^^\ We can then define the exchangeable K-recipe G o V : pt K by letting 

(G o 77)('^) .— G o ; one easily verifies that this is indeed an exchangeable K-recipe. (IfV was a sub- 
Cantor space, and thus identifiable with a sub-Cantor palette of order 1, one could interpret 17 : pt ^ 
as an exchangeable V -recipe, and G : V ^ K as a deterministic natural transformation; however, we will 
not need to adopt this perspective here.) 

Example 3.17 (Inclusion as a natural transformation). If K is a finite palette and V is a hereditary K- 
property, then the inclusion natural transformation l : V ^ K is a deterministically continuous natural 
transformation. 

Example 3.18 (Local modification rule as natural transformation). A local modification rule T — (T, A) on 
a finite palette K can be viewed as a deterministically continuous natural transformation T : K, 
with the maps t'^^^ : K^'^'^^^ if^^-* given by either Definition \l.26\ or Definition U .27\ the locality 
condition ( I31l l reflects the fact that the colour assigned to an edge (j) G Inj([j], V) by such a rule only 
depends on the restriction of the original graph to AU (f>{[j]). IfV is a hereditary K -property V, then 
T entails V if and only if the associated natural transformation T factors through the inclusion natural 
transformation l : V ^ K. 

Definition 3.19 (Direct sum of natural transformations). IfYi and I2 are contravariant functors, we define 
the Cartesian product Yi x Y2 to be the contravariant functor defined by (Yi x 12)'^'' Y^^^ x Fj^^'' 
for all vertex sets V, and (Yi x 12)^*^^2/112/2) := {Y^'^\yi),Y2'''\y2)) for all morphisms tp e lni{W,V) 
and points j/i G Y-[^\ y2 G Y2^\' one easily verifies that Yi x Y2 is indeed a contravariant functor If 
Ni : Z\ —t Y\ and N2 : Z2 —* Y2 are natural transformations, we define the direct sum iVi © N2 ■ Z\ x 
Z2^Y\~K Y2 to be the natural transformation defined by (iVi A^2)^^H-2^ii -^2) = (-^i^''(^i); ^2^''(^2)) 
for all vertex sets V and points Zi G zj^-* and Z2 G •^2^''; one easily verifies that Ni © N2 is indeed a 
natural transformation. 

Example 3.20. If Z ^ {Z^f^ is a sub-Cantor palette, then we have Z — Z^q x . . . x Z^k os contravari- 
ant functors. Ifa= {aj)j^Q : Z ^ Ais a colouring, then we have a = So ® ■ • • ® Ofe. 

We now turn to an important weak compactness property of recipes, which in fact is the main reason why 
we have set up all this infinitary machinery in the first place. 

Definition 3.21 (Vague convergence of recipes). Let Z be a sub-Cantor palette, let : pi ^ Z be a 

sequence of exchangeable Z-recipes, and let fj, : pt ~f Z be another exchangeable Z-recipe. We say that 
/i„ converges vaguely to ^ if /ii^' converges vaguely to pS-^^ for every vertex set V ( see Appendix\A\for a 
definition of vague convergence of measures). 
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Lemma 3.22 (Vague sequential compactness of recipes). Let Z be a sub-Cantor palette, and let /z„ : 
Z be a sequence of exchangeable Z -recipes. Then there exists a subsequence : pt Z which 
converges vaguely to another exchangeable Z -recipe /i : pt ^ Z. 

Proof. Let S" be a countably infinite vertex set. Then by Lemma lATSl we can find a subsequence /i„^ : pt 
Z such that the probability measures p!"n^ e Pr(Z('^') converge vaguely to a measure /x'"^) e Pr(Z'^'^)). 
Observe from dig that 

° l^^n} — l^rii' for all (/) e Inj(5, S). Since Z^"^' is continuous, we can use 
vague convergence and conclude that 

Z(^)o^(^) =^(^). (32) 

We can then define the exchangeable Z-recipe /i : pt ^ Z by defining /i'^^ Z^"^^ o /i^'^) for any 
vertex set V and any morphism (p G Inj(V, S); one easily verifies from (|32] | that /i is well-defined and is 
an exchangeable Z -recipe. Also, as /i^"^^ converges vaguely to fi''-^\ one can see (by pulling back by an 

arbitrary morphism (p G Inj(y, 5)) that /il^^ converges vaguely to /i^^^ for all vertex sets V. The claim 
follows. □ 



3.1.2 A structure theorem for exchangeable random hypergraphs 

In the infinitary framework, graphs and hypergraphs will be modeled by exchangeable recipes, via the 
sampling operation in Definition [TT6] In order to use this formalism, we will need a classification of all 
the possible exchangeable recipes that one could associate with a given palette Z. Such a classification is 
analogous to the Szemeredi and hypergraph regularity lemmas in the finitary setting, or to the description 
of 'limit objects' of certain sequences of finite graphs or hypergraphs in terms of 'graphons' and 'hyper- 
graphons' in the works of Lovasz and Szegedy ll27l and Elek and Szegedy ITTI . (The k — 1 version of 
this classification is essentially de Finetti's theorem, a foundational result in the study of exchangeable 
probability measures.) 

In fact, the classification that we need has been available in the probabilistic literature for quite some time, 
appearing first in the study of 'exchangeable arrays of random variables' in the work of Hoover iflTlfTsl . 
Aldous |[l]|2][3l and Kallenberg 121]. Their formalism is slightly removed from the more combinatorial set- 
up and demands of the present paper, and so we refer the reader to [7J for a description of the relationship 
between them and versions of these results suited to our present purposes. 

Let us first give some illustrative examples of exchangeable Z-recipes that provide simple instances of the 
general result to follow. 

Example 3.23 (Random vertex colouring). Let Z = (Zo, Zi) be a palette of order 1, let Pq € Pr(Zo) be 
a probability measure (and thus identifiable with a Z<Q-recipe Pq : pt — > Z<oj, and let Qi : Zq ~^ Z\ 
be a probability kernel. If we then define the probability kernel P\ : Z<o Z by the formula P'^^ (z) := 
Qi{z)^ for all vertex sets V and z € Zq, then /i P\ o Pq is an exchangeable Z-recipe. This recipe 
colours a given vertex set V by first assigning a colour z ^ Zq at random with law Pq to the empty set, and 
then assigning a colour in Z\ to each vertex independently at random with law Qi{z). 

A classical theorem of de Finetti asserts (in this language) that if Zi is a sub-Cantor space and fi^i is 
an exchangeable Z^i-recipe, then there exists Zq, Po,Qi, fi as above such that = n o ^, where 
TT : Z ^ Z=i is the projection map. This theorem gives a satisfactory classification of exchangeable 
recipes on palettes of order 1, and the later work of Hoover, Aldous and Kallenberg was motivated by an 
effort to generalise this special case. 
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Example 3.24 (Erdos-Renyi hypergraphs). Let Z = {0, l}fc/or some k > 1, and let Q < p < 1. Then 
we can define the exchangeable Z-recipe : pt Z by setting /x'^^-' = Jlee(^) l^p,e fi"" '^^^ vertex sets 

V, where we identify {0, 1}^^'' with Y[ee(^){^^ ^y'k^' '^^'^ /^p,e G Pr({0, l}^'^'') is the law of the random 
hypergraph of order k on e which is complete with probability p and empty with probability 1 — p; thus 
^(^) is the law of a random undirected hypergraph of Erdos-Renyi type. 

Example 3.25 (Random complete bipartite graph). Let Z = (pt, {0, 1}, {0, 1}), and let Qi £ Pr({0, 1}) 
be the uniform measure on {0, 1}. From Example 13.231 Qi induces a Z<ci-exchangeable recipe Pi : 

pt —> Z<_\. We also define a natural transformation P2 : Z<i —^Zby the formula P2^\z) :~ Sz x 

nee(^) Q'2\^ U) for oil vertex sets V, where we identify Z^^^ with ^<^^ x J^^g^v^ ■2^=2. and for any 

e — {v^ w\ and z — (z^,, Zyf) £ Z^^-^, q')^'' (z) is the law of the random graph on e which is complete when 
Zv 7^ and empty otherwise. The recipe ji -P2 o -Pi is then an exchangeable Z-recipe, which describes 
a random complete bipartite graph on any given vertex set V. 

Example 3.26 (Erdos-Renyi graphs with random density). Let Z — {Zq, pt, {0, 1}), let Po E Pr(Zo) be 
a probability measure, and let p : Zf) ^ [0, 1] be a measurable function. We can view Pq as a natural 
transformation Pq : pt ^ Z<o. We can then define the natural transformation P2 : Z<,i —* Z by setting 
P2^'(zo) — ^za ^ W^^(v^[i^i^za) for all vertex sets V and all Zq E Zq = Z^^^\ where we identify Z'^^^ 

with Z^^^ X neG(^) ^=2' 

the measures defined in Example \3.24\ Then ^ := P2 o Po is 
an exchangeable Z-coloured hypergraph, which describes an Erdos-Renyi random graph whose expected 
edge density p is itself a random variable. 

Example 3.27 (Random directed complete graph). Let Z — {0, 1}2 and let P2 : pt ^ Z be exchangeable 
Z-recipe P2^'' = IleeC) ^^^''^ fa'' ^'^ch e — {v, w}, Q^2^ G Pr({0, 1}2'^'') is the law of the random 
directed graph G2 ■ Inj([2], e) — > {0, 1} such that G2{v, w) = \ and G2{w, u) = with probability 1/2, 
and G2{v, w) — and G2{w, v) = 1 with probability 1/2. Thus Pj^^"* is the law of a random directed 
complete graph on V, on which given any two vertices v and w, exactly one of the directed edges (w, w) 
and (w, v) will lie in the graph, with an equal probability 1/2 of each. 

Example 3.28 (Random 3-uniform hypergraphs). We now consider a somewhat more general example 
than those above. Let Z — (pt, Zi, Z2, {0, 1}), let Qi G Pr(Zi) be a probability measure, let Q2 : 
Zi X Zi Z2 be a symmetric probability kernel, and let p : Z^^"^ — > [0, 1] be a measurable function 
which is symmetric with respect to the Inj([3], [3]) action on the base z'^^'^ = Zf x Zf. (Actually, for this 
construction, only the values ofp on undirected hypergraphs in Z^^"^ - a set which is identifiable with Zf x 
Z2 - will be relevant.) From Example \3.23\ with Zq — pt, Qi induces a natural transformation Pi : pt ^ 
Z<i. Similarly, the map Q2 induces a natural transformation P2 : Z<i Z<2 defined by P2^\z) := 
^ neG(^) '52^^'' (-2^ Le) /<"" oll Vertex sets V and z G Z^^^, where for each e = {u, w}, Q^^^z^^ ^ui) 
is the law of the random hypergraph Ge in Z'l2 which is symmetric (thus Ge{v,w) = Ge{w,v)) and 
such that Ge{v, w) has law Q2{v, w) = Q2{w, v). The function p also induces a natural transformation 
P3 ■ 'Z<2 ^ Z, defined by P^"* (z) (5^ x J^^g^v-j Q''^\z [^) for all vertex sets V and z G Z^^' 

where Qg^^^'"^'"^^"* (y) is the law of the random hypergraph in {0, ij^'t^i'^'^'^^^' which is complete with 

probability p(z'^^2^^'^^^ iv)) and empty otherwise (note that the exact ordering o/{wi, W2, W3} is irrelevant 
due to the symmetry assumptions on p). This generates an exchangeable Z-recipe fi :— P3 o P2 o Pi, 
which creates a hypergraph on any vertex set V by first using Qi to colour the vertices, then Q2 to colour 
2-edges, and finally Q3 to colour 3-edges. This sort of recipe has also appeared, for example, in the 
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different formalism of 'hypergraphons ' studied in [Tl^, and can be viewed as the infinitary analogue of the 
regularisations offinitary hypergraphs given for instance in A 7 51/ or l[31]l . 

These examples can be generalized to create exchangeable recipes of any given order To do this, we 
introduce some more notation. 

Definition 3.29 (Independence). Let X be a sub-Cantor space with a probability measure fi G Pt(X), 
and let iTa '■ X ^ Y^, a (z A be a collection of measurable maps to other sub-Cantor spaces Ya. We say 
that the maps tt^ are jointly independent relative to fi if we have 

for all finite subsets A' of A and all bounded measurable functions fa'Ya^ R~ 

Remark 3.30. // we choose x ^ X at random with law /i, then the tTq are jointly independent relative to 
/i if and only if the random tTq, [x) G Y^ are jointly independent in the usual probabilistic sense. 

Definition 3.31 (j-independence). Let N : Z ^ Y be a natural transformation, and let j > 0. We say that 
N is j-independent if for every vertex set V and every z G Z^^\ the restriction maps ttw '■ Y^^^ y (W') 
for G (^) are jointly independent relative to the measure 

Remark 3.32. Informally, j -independence asserts that for any fixed z G Z^^\ the j-edges of the random 
element ofY^^^ drawn using the law N^^'^^z) are jointly independent random variables. For instance in 
Example \3.23\ once one fixes z G Z^, P\ colours the vertices in V independently with law Qi{z), and 
thus Pi : Z<o Z<i is 1-independent. (Note, however, that if z G Zq is chosen randomly rather than 
deterministically, then the colours assigned to vertices in V need not be independent any more.) More 
generally, in all of the examples discussed earlier in this section, the natural transformations Pj : Z^j —^ 
Z<cj that appear in those examples are j-independent. 

Exampie 3.33. Let Z be a contravariant functor and j > 0. Let Y^j be a sub-Cantor palette with only 
the j*"^ component non-trivial, and let Q^^^^^ : Z*^!^!^ ~^ y^bl) he a probability kernel which is liij([j], [j])- 

equivariant, thus Y^^ o Q^I^D = Q'^D o Z^'^^ for all (f> G Inj([j], [j]). If we then define the natural 
transformation Q . Z ^ Y=j by 

Q(^)(z):^ n YifKQm{z(<^^\z)) 

for all vertex sets V and all z G Z^^)^ where we identify Y^^ with JlesC) ^5^' '^'^^ where we choose 
an arbitrary morphism if)c, G hij([j], e) for each e G (^) (the exact choice of (f)^ is irrelevant, thanks to the 
Inj([j], [j])-equivariance of Q'^^^^'^), then one verifies that Q is a j-independent natural transformation. In- 
deed, Q is the unique j-independent natural transformation which agrees with Q'^'-'''' at [j], and conversely 
every j-independent natural transformation from Z to Y^j arises in this fashion. 

Definition 3.34 (Regular exchangeable recipes). Let Z be a sub-Cantor palette of some order k > 0, and 
tef /i : pt — > Z be an exchangeable Z -recipe. We say that fj, is regular if there exists a factorisation 

/i = Pfe o . . . o Po 

where for each < j < k, Pj : Z^j — > Z<cj is a j-independent natural transformation which partially 
inverts the projection natural transformation tTj : Z<cj Z^j in the sense that iTj o Pj — lAz^y (Here 
we identify Z with Z<fe in the obvious manner.) 
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Remark 3.35. If one sets fj,<j = /x<j+i 
commutative diagram whose j^^ layer for j 



pt 



. . . o Pq, then the situation can be described by a 
k takes the form 



pt 



(33) 



idz. 



z. 



<3 



Example 3.36. Let Z be a sub-Cantor palette of order k > 0. If < j < k and Q 

is a lni{[j],[j])-equivariant probability kernel, and Qj : Z^j —>■ Z= 



am . ^(bi) 



z 



am 



natural transformation, as defined by Example 13.331 then the natural transformation Pj . zy<j 



defined by P- (z) 



AV) 



X Z^^^\ is a j -independent natural transformation with nj o Pj — idz^^- Thus by selecting a Qj 
for each < j < k and then composing the resulting Pj together, one obtains a regular exchangeable 
Z-recipe p; conversely, all such regular exchangeable Z-recipes arise in this manner 



r 



{z) for all vertex sets V and z e Z^^\ where we identify z'^^^ 

id. 



J is the associated j-independent 
■ Z^i > Z<^j 
with 

am 



In terms of the notation set out above, we can now state the full structure theorem that we need. 

Theorem 3.1 (Structure theorem). Let K be a finite palette of some order k > 0, let fi : pt ^ K be an 
exchangeable K-recipe and let S be a countably infinite vertex set. Then there exists a sub-Cantor palette 
Z, a deterministically continuous natural transformation A : K'^^ — > Z, and a colouring map k : Z ^ K 
such that the natural transformation 7t o A : K^^' K is just the restriction map, thus 

(koA)(^)(G)-G Ly (34) 

for all vertex sets V and all G G and such that A o p^^ : pt ^ Z is a regular exchangeable 

Z-recipe. 

Remark 3.37. The situation in the structure theorem can be summarised by the following commutative 
diagram, 

^ms z — ^ K 



(35) 



pt ^=^= pt ^=^= pt 

with the map from K^^ to K being the restriction map (by (|34| l), and the middle vertical map being an 
exchangeable Z-recipe and thus factorable as Pj^o . . .o P^for some j-independent ingredients Pj : Z^j 
Z<j. 



Proof. See Theorems 3.15 (for the undirected case) and Theorem 3.22 (for the general case) in fTj. □ 



Informally, the above theorem asserts that any exchangeable recipe can (after adding a sufficient number 
of "hidden variables") be constructed from randomly colouring 0-edges, then 1-edges, then 2-edges, etc. 
as in Examples I3.23H3.28] It is analogous to the hypergraph regularity lemma, which roughly speaking 
asserts that any fc-uniform hypergraph G = (V, E) can be regularised by first colouring (i.e. partitioning) 
the 1-edges (i.e. vertices), and then on each pair of 1-cells, colouring/partitioning the 2-edges between 
those cells in a regular fashion (regularity being the analogue of 2-independence), then on each triplet of 
1-cells and triplet of 2-cells, colouring/partitioning the 3-edges with vertices in the 1-cells and 2-edges in 
the 2-cells in a (hypergraph)-regular fashion, and so forth. 
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3.2 Infinitary reductions of main theorems 



In this section, we use the structure theorem to deduce the main positive results of this paper (Theorems ! 1.51 
ll.6lll.7|[l.8b from infinitary counterparts (Proposition l3 .461 13 .471 13 .481 13 .491 ). which will then be proven in 
later sections. 

We begin with some notation. 

Definition 3.38 (Entailment). Let K be a finite palette, let V be a hereditary K-property, and let N : 
Z ^ K be a natural transformation from some contravariant functor Z. We say that N almost entails V 
if we have N^^\z){V^^'') = I for all vertex sets V and all z G Z^'^\ We say that N entails V if N is 
deterministically continuous and almost entails V. 

Remark 3.39. IfN is deterministically continuous, then N^^^ can be viewed as a continuous function from 
Z^^-* to K^^\ and then the assertion that N entails V is equivalent to the claim that N^'^'> {Z'^^ ) C V^^^ . 
Note that this notation of entailment is consistent with that in Definition U .27\ after using Example \3.18\ 

Remark 3.40 (Alon-Shapira finitisation trick). From ^ in Definition U. 16\ and ( |28] | in Definition 13. 7 7 1 we 
see that to verify that N almost entails V, it suffices to verify N^^^ {z){V^^'^) = Ifor a single countably 
infinite vertex set V and all z £ Z'^^\ Actually, from countable additivity and the way V is extended from 
finite hypergraphs to infinite ones, it suffices to verify N^^"^ (z) (T't^) ) = Ifor all finite vertex sets V and all 
z G Z^^\ For similar reasons, to verify that a continuous natural transformation N : Z ^ K entails V, it 
suffices to show that iV'^^ (Z^^^ ) C V'^^^ for all finite V. This ability to reduce entailment to verification 
on finite vertex sets is crucial to our arguments; not coincidentally, an analogous finitisation observation 
played a similarly central role in 

Definition 3.41 (Infinitary repairability and testability). Let K be a finite palette of some order k > 0, 
and let V be a hereditary K-property. We say that V is infinitarily testable with one-sided error ( resp. 
infinitarily strongly locally repairable) if given any sub-Cantor palette Z of order k, any colouring k : 
Z K, any regular exchangeable Z -recipe fi : pt Z such thatKo almost entails V, and every e > 0, 
there exists a weakly continuous (resp. deterministically continuous) natural transformation T : Z —t K 
that almost entails ( resp. entails) V and is close to k in the sense that 

[ T(W)(z)(if(W)\{«(W)(^)})d/i(W)(z)<£. (36) 

Remark 3.42. When T is deterministically continuous, i36i simplifies to 

Example 3.43 (Testing and repair of the triangle-free property, I). Let Z — (pt, Zi, {0, 1}) be a sub- 
Cantor palette, let K := {0, 1}2, and let k : Z K be the colouring map which is the identity on the 
order 2 component and trivial on lower order components. Let Qi G Pr(Zi); and let Pi : pt — > Z<i be 
as in Example \3.23\ Let p : Zi x Zi — )■ [0, 1] be a symmetric measurable function, and let P2 '■ Z<i — > Z 

be the 2-independent natural transformation P2^\z) :— Sz x JleeC) '^2'^^^^ ^"^^ '^'^ '^^''t^x sets V 

and z € Z^^\ where for each e — {v, w}, Q^2\^vj ^w) is the law of the random graph on the doubleton 
e which is complete with probability p{zy,Zw) and empty otherwise. Then fi :— P2 o Pi is a regular 
exchangeable Z -recipe ( closely related to the graphons introduced in [27]); it randomly colours any vertex 
set V by assigning each vertex v € V a random colour Gi{v) in Zi with law Qi, and then assigns 
any edge {v, w} the colour 1 with probability p{Gi (v) , Gi (w)), independently for all edges {v, w} ( once 
the colours Gi{v) have all been picked). Let V be the hereditary K-property of being undirected and 
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triangle-free. Observe that /i will almost entail V if we have p(x, y)p{y, z)p{z, x) = Ofor Qi-almost every 
x,y,z € Z\; suppose that this is the case. Now we seek a weakly (resp. deterministically) continuous 
natural transformation T : Z ^ K that almost entails (resp. entails) V, and is close to K : Z K 
(observe that k itself does not entail V at all) in the sense of i36\ . We know of two methods to achieve 
this, which we shall call the Rodl-Schacht method and the Alon-Shapira method, being loosely based on 
the constructions in l[30]l and respectively ( we will also discuss finitary analogues of these schemes 
in the next remark). Both methods proceed by first choosing a refinement a : Z ^ A of k : Z K, 
which amounts to subdividing the vertex space Z\ into finitely many clopen "cells" OL^^{\a\); the finer 
one takes the colouring a, the better the value of e one will eventually obtain in (136b . The Rodl-Schacht 
method then constructs the law T^^^{z) £ Pt{K^^^) of a random K -coloured graph on a vertex set V, 
starting from a Z -coloured graph z g Z^^\ as follows. For each vertex v £ V, one looks at the cell 
Cy :— a^^ {a{zi{v))) G Zi that zi{v) lives in. If this cell has positive measure with respect to Qi, then 
we select a point C^, G Cy at random with law (QijC^) (see Appendix\A\for the definition of conditioned 
measure). Otherwise, we select (^y g Zi with law Qi. Note that in either case, the law ofCv is absolutely 
continuous with respect to Qi. We perform this selection procedure independently for each v £ V. One 
now selects T^^\z)2{v,w) = T^^\z)2{w,v) G {0,1} for each {v,w) G ln]{[2],V) separately by the 
following rule: 

• If Z2(v,w) = Z2{w,v) and p{Cy,Cw) = p{Cw,Cv) 7^ 1 - Z2{v,w), then set T'^'^\z)2(v,w) = 
Z2{v, w) and T^^\z)2{w, v) — Z2(w, v). 

• Otherwise, set T^^\z)2{v, w) = T^^-* (2)2(10, v) equal to 1 with probability p{C,w, C,y), and equal to 
otherwise. 

One can verify that T is a weakly continuous natural transformation which almost entails V, and that ( I36l l 
is obeyed for sufficiently fine a, which demonstrates that V is infinitarily testable with one-sided error 

Now we turn to the Alon-Shapira method, which is more complicated, but constructs a natural transforma- 
tion T : Z K which is deterministically continuous rather than weakly continuous. To simplify matters 
we shall take advantage of the monotonicity of the property V, and also make the additional assumption 
that the measure Qi is atomless ( i.e. Qi {{z}) — O for all z G Zi). Let a : Z A be as before. For each 
a £ Ai independently in turn, we construct the cell Ca '■— ai^{{a}), and select (a G Zi at random with 
law (Qi|Cq) if Qi[Ca) > 0, and with law Qi otherwise. For each pair {a, a'} G {^2)' ^^^^ select 
Ca,a' = Ca',a G {0, 1} independently at random, such that C^a,a' — 1 with probability p(^Ca, Ca')- With all 
these choices, we then define the ( random) deterministically continuous natural transformation T : Z K 
by setting T^^^ (2)2 (w, vS) = T^^\z)2{w , v) for vertex sets V, z £ Z^^ , and {v,w) G Inj([2], V) by the 
following rule: 

• Ifo:i{v) 7^ ai{w), Z2{v,w) = Z2{w,v), and p(C,a^(y),C,ai(w)) = PiCa^iv), Cai{w)) 7^ 1 - Z2{v,w), 

then we set T*^^) (2)2(1', w) = T^^-* (2)2(10, v) — Z2{v, w). 

• If ai{v) 7^ Q-i{w) but we are not in the previous case, we set T'^^\z)2{v , w) — Cai{v),ai(wy 

• If we are in the "diagonal case" ai{v) — 01(111) then we set T*^^-* (2)2(11, w) = Cai{v).ai{w) = 0- 

One can verify that with probability 1, T is a deterministically continuous transformation which entails V; 
the monotonicity ofV is used to ensure that the "zeroing out" of the diagonal case does not interfere with 
this entailment. One can also verify ( I36l l if the colouring a is sufficiently fine; the atomless nature ofQi is 
used to ensure that the contribution of the diagonal case can be made arbitrarily small. (One can handle 
the diagonal contributions of any atoms in Qi by adding an additional case to the above rule; we leave the 
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details to the interested reader. ) IfV is not monotone, the diagonal case causes much more difficulty, and 
needs to be coloured according to a colour provided by an application of Ramsey's theorem; see [6] for 
details (albeit in a rather different language). 

Example 3.44. Testing and repair of the triangle-free property, II] We now adapt the above discussion 
to the finitary setting, to help provide a partial dictionary between the finitary and infinitary worlds. Our 
discussion will be somewhat informal. We start with a fixed graphon - a measurable symmetric function 
p : [0, 1] X [0, 1] — > [0, 1] by the following procedure. Given such a graphon, and given a vertex set V, 
we construct a random graph G — {V, E) by the following procedure. First, randomly assign to each 
vertex v € V a colour Gi{v) e [0, 1] using the uniform distribution on [0, 1], with each vertex being 
coloured independently. (Note that the uniform distribution on [0, 1] is atomless, thus avoiding some of the 
technicalities alluded to in the previous example.) Next, we define the edge set E of G by declaring each 
edge {v, w} to lie in E with probability p{Gi{v), Gi(w)), with these events being independent once the 
colours of the vertices have been chosen. 

The finitary analogue of the Rodl-Schacht method involves two vertex set^^ a relatively small one V and 
a very large one V*, and generates two random graphs G ~ {V, E), G* — {V*,E*) using the same 
graphon p. We assume that the large graph G* is very close to being triangle-free, and in particular we 
assume that the triangle density ofG* is extremely small compared to the size \ V\ of the smaller graph. On 
the other hand, the triangle density of G* is extremely close to the quantity 



We may thus assume (with high probability) that this quantity is very small - smaller than any quantity 
depending only on \V\. 

We then use the nearly triangle-free nature of G* to obtain a genuinely triangle-free perturbation G' = 
(V, E') of G as follows. Pick a large number N (much larger than \ V\) and subdivide the intervals [0, 1] 
into N intervals Ii, . . . , 1^ of equal length. We then define a random map : V [0,1] as follows. For 
each V € V, we look at the colour Gi (w) € [0,1] ofv; this falls into one of the intervals li of [0,1]. We then 
pick an element of li uniformly at random and call this C.y. (Note that different v,v' € V may correspond 
to the same i, but in such cases we pick C,^ , C,^i independently; in any event, such collisions will be rare if 
N is chosen large enough depending on \V\.) This gives rise to a random map C, : V ~* [Q, 1]. From the 
smallness of (I38l l and the first moment method we see that the quantity 



can be made (with high probability) to be as small as desired depending on \V\. 

We use this map C, to construct G' = (V, E') as follows. We will need a small threshold ct > depending 
on \V\. Let {v, w\ be an edge in V. 

• If {v, w} G E, and p{(y, ^ cr, we place {v, w} in E'. 

• If {v, w} G E, and p{(y, Cw) < cr, we exclude {v, w} from E' . 

• If {v, w} (fi E and p{(^y, ^u,) < 1 — a, we exclude {v, w} from E'. 

-'of course, in the initial setup in | 30| no graplion is initially provided. Instead, one takes a hypothetical sequence of increasingly 
large counterexamples to the local testability claim, passes to a subsequence which does converge to a graphon p (cf. Lemma [3.22t , 
selects two widely separated elements of this sequence, and then applies the argument described here. 




(38) 





(39) 



£V, distinct 
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• If {v, w} ^ E and p{(^y, (w) < 1 — cr, we place {u, w} in E'. 

One can check ( if i39\ is sufficiently small) that G' is genuinely triangle-free; meanwhile, from the Lebesgue 
differentiation theorem we know that p is approximately constant on most cells li x Ij; since G is gen- 
erated using p, this can be used to show that G and G' differ in a relatively small number of edges if the 
parameters are selected correctly (it is here that it is crucial that N is large compared with \V\). Note 
however that the rule generating G' from G is not local in nature, as it requires an initial assignment of a 
real number C,^ G [0, 1] to each vertex v and thus requires far more "memory" than is available to a local 
modification rule. Also, the "complexity" N of the modification procedure here has to be large compared 
with V, and in particular this procedure would not work ifV were infinite. 

Now we briefly sketch the Alon-Shapira approach to constructing G'. Here we will not use the large graph 
G* , and work solely with G. We assume that G is close to triangle-free, thus we may assume that (I38l l is 
small; but now the bound is much weaker More precisely, for any 5 > Q, we may assume that (I38l l is less 
than 5, but only if\V\ is sufficiently large depending on 5; we no longer have the luxury of assuming ( I38l l 
to be arbitrarily small depending on V. 

We now construct the perturbation G' by a variant of the Rodl-Schacht method. We pick an N which is 
moderately large, but now independent of |V^|, and create the intervals Ii, . . . , 1^ as before; this induces 
a partition V — T^i U . . . U Vn ofV into cells which (with high probability) are of roughly equal size. 
Rather than assign a number (^y g [0, 1] to each vertex v € V, we now only assign a number Q G hfor 
each 1 < i < N, drawn uniformly at random from li and independently for each i. We then construct 
G' = (V, E') as follows for v € Vi,w ^ Vj, this time with a threshold a > that is small compared with 
N, but independent of\V\: 

• If {v, w} Cz E, i ^ j, and p{Q, Cj) ^ place {v, w} in E'. 

• If {v, w} Cz E, i ^ j, and p{Q, Cj) < f> exclude {v, w\ from E'. 

• If {v, w} ^ E, i ^ j, and p(Q, Q) < 1 — cr, we exclude {v, w} from E'. 

• If {v, w} ^ E, i ^ j, and p{Q, Cj) < 1 ~ cr, we place {v, w} in E'. 

• If i — 3' we exclude {v, w} from E'. 

This procedure will (if V is large enough to ensure (I38l l sufficiently small depending on N,a) create a 
triangle-free graph G' which is close (with high probability) to G. Technically, G' is not obtained from G 
from a local modification rule; however, the rule that decides when an edge {v, w} belongs to G' depends 
only on whether {v,w} lies in G, and on the cells Vi, Vj that v,w lie in. As mentioned before, the Vi 
can be viewed as a Szemeredi partition of the graph G. Another way to obtain a Szemeredi partition is to 
select a number of random vertices Ui, . . . , Ufe and use the neighbourhoods of these vertices to determine 
a partition; see e.g. [19]. Using such a regularisation instead of the one based on the intervals /i, . . . , /„, 
one can eventually obtain a local modification rule that repairs G to a triangle-free graph and which only 
modifies a small number of edges on the average; we omit the details, which could in principle be extracted 
from the argument in [6] using random vertex neighbourhoods to regularise graphs as in l[19]l . 

The connection of the notions in Definition 13.411 to the those in Definitions 11.181 11.311 is given by the 
following correspondence principle. 

Proposition 3.45 (Correspondence principle). Let K be a finite palette, and let V be a hereditary K- 
property. 
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( i) IfV is infinitarily testable with one-sided error, then V is testable with one-sided error. 



(ii) IfV is infinitarily strongly locally repairable, then V is strongly locally repairable. 



Proof. Let k denote the order of K. We first prove (i). Suppose for contradiction that V is infinitarily 
testable with one-sided error but not testable with one-sided error. Carefully negating all the quantifiers, we 
conclude that there exists an error tolerance e > and a sequence Gn & X^^"^ of /^-coloured hypergraphs 
on finite vertex sets Vn with \ Vn\ > niax(n, k), which increasingly locally obey V in the sense that 



W G 



> 1 - 



but is far from V in the sense that for any n, there does not exist any G'^ G 'pi'^n) for which 



1 



W G 



Gn [w^ G'n 



iw 



< e. 



From ( l40b and the hereditary nature of V we easily see that 

1 



lim 

n — >oo 1 1 



W G 



Gn iweV 



(W) 



= 1 



(40) 



(41) 



(42) 



for all fixed iV > 1. 



We now arbitrarily extend each Gn G K^^'^^ to a X-coloured continuous G„ on Vn as in Example II. 241 
endowing each Vn with uniform probability measure z^„. By Definition 13. 161 we thus have a sequence of 
exchangeable X-recipes Gn o 1^7 : pt ^ if. From (|42] | (and the fact that |y„| — > oo as n oo) we see 
that the G„ o increasingly entail V in the sense that 



lim (G„ 



(43) 



for any > 1 . 



By Lemma [3.22l and passing to a subsequence if necessary, we may assume that Gn ° Vn converges vaguely 
to an exchangeable ^fC-recipe /i : pt ^ JC. From (l43l l (and the fact that T-"'-'^!^ is clopen) we conclude that 
^([A^])(-p([JV])) = 1 for all N. By Remark [l40l we conclude that ^ almost entails V. 



Let 5 be a countably infinite vertex set. We now invoke Theorem 13. II to obtain a sub-Cantor palette Z, a 
natural transformation A : K'*'^ Z and a colouring k, : Z ^ K such that A o ji^^ : pt — > Z is a regular 
exchangeable Z-recipe. From (l35T l we see that k o A o ^i^^ = fi, thus no Ao pi^^ almost entails V. 



Let She a small number (depending on e and k) to be chosen later As V is infinitarily testable with one- 
sided error, we can find a weakly continuous natural transformation T : Z ^ K that almost entails V such 
that 

T(W)(z)(if(W)\{7«(W)(z)})dA(W)o/i(W«^)(z)<5. (44) 
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The situation can be summarised by the commutative diagram 

L 

K V 




(45) 



where the two maps T, k are close in the sense of (136b . The fact that almost entails V means that it in 
fact factors through the inclusion map l : V ^ K, and similarly for T. 

Fix this T, and let n be a large integer to be chosen later. We perform the following random construction. 
Let N be the natural numbers (actually, we could use any countably infinite vertex set here). Let e 
be a point drawn at random with law i'^ (or equivalently, ^ : N ^ is a random function from N to 
Vn). Then the point 

z:=A(N)(G^^''\v)) (46) 
is a random point in Z^^^^ with law (A o (?„ o T7^)'-^K 

After choosing tp and hence z, let G G K'^-^^ be drawn at random with law T^^") (z). By construction of T, 
we see that G almost surely obeys V. 



We now claim that for n sufficiently large we have 



(47) 



for all e G ( J, ) . As the joint distribution of {z, G) is exchangable with respect to the action of Inj (N, N), 
we see that the probability on the left is independent of the choice of e, and so it suffices to verify WT\ 
for e — [k]. Since T is a natural transformation, we observe that for fixed z, G t[/c] has the distribution 

^"'•''''-'(^ L[fe])- Also,2: t[/c] has the distribution A(W)o(G„oj7;7)(W*'S'). We can thus re-express the left-hand 
side of Wi\ as 

r(W)(z)(if(W)\{«(W)(z)}) dA(M) o (G;oI7^)(W«^^)(z). 

But as T is weakly continuous, the integrand here is continuous. Since (?„ o converges vaguely to /it, 
the claim WT\ thus follows from (l44l i. 

Now let M = Mn be a large integer (depending on \ Vn \ and e) to be chosen later The vertices -0(1), ... , i'iM) G 
Vn are drawn uniformly at random, so by the law of large numbers we see (if M is sufficiently large) that 
with probability at least 1/2, that we have 



^<|{™g[M]:0M=«}|< — 



(48) 



for all V G Vn- (Note that it is crucial here that M is taken large compared to 1 14, |; it is because of this that 
we only obtain testability here rather than local repairability.) 
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We now condition on the event that ( 1481 ) holds. Because this event has probabiUty at least 1 /2, we see that 
after this conditioning, G still continues to obey V almost surely, and from ( |47] ) we have 



(49) 



forallee(^). 

For any v e Vn, let rriy S [M] be chosen uniformly and independently at random from the set {m € [M] : 
tp{m) =ti}, which is non-empty by (08]). This gives us a random function to S Inj(l^, N) which partially 
inverts ijj. We then define the hypergraph G'„ £ K^^"^ by the formula := K^"^\G). From (|46] | we 
also have G„ = K^''''^k^^'> (z)). 

Since G almost surely obeys V, the hypergraph GJ^ = K^'^\G) does also. From (l48T l. ( |49] |. and the 
construction of to we also see that 

P(G„ [w^ g; Lw) «fc ^1 Inj([fc], K)|; 



by linearity of expectation, we thus have 

1 



E( 



W e 



Vn 



Gn [w^ G^ 



Thus by the the first moment method, there exists a deterministic hypergraph G'^ G -pi^-n.) g^-jj jjj^j 

1 



: G„ [w^ G'n [w 



Choosing 5 sufficiently small depending on e, we obtain (HTI) . which is a contradiction. This concludes the 
proof of (i). 

Now we prove (ii). Suppose for contradiction that V is infinitarily strongly locally repairable but not 
strongly locally repairable. Carefully negating all the quantifiers, we conclude that there exists an error 
tolerance e > and a sequence of A'-coloured continuous hypergraphs (G„),i>i, each on a different 
probability space (y„, Bm Vn), which increasingly obey V in the sense that 



lim 



for every N, but such that for each n, there does not exist any modification rule T = {A, T) entailing V 
with \A\ < n for which 



IT, 



< £. 



(50) 



As in the proof of (i), we may assume after passing to a subsequence that the exchangeable if -recipes 
Gn olT^ : pt K converge vaguely to an exchangeable if -recipe fi : pt K which almost entails V. 

Let 5 be a countably infinite vertex set. As before, we invoke Theorem 13. II to obtain a sub-Cantor palette 
Z and natural transformations A : K'^^ Z and n : Z ^ K, with A o ^'^'^ : pt ^ Z is a regular 
exchangeable Z-recipe, and with k o A o almost entaihng V (by (135))). 
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As V is infinitarily strongly locally repairable, we can find a deterministically continuous natural transfor- 
mation T : Z ^ G entailing V such that 

A(W) o e : f ^ 7«(W)(z)}) < e. (51) 

The situation is once again depicted by ( |45] ). except with the weakly continuous T replaced by the deter- 
ministically continuous T. 

Now consider the map 

This is a continuous map from the sub-Cantor space K'^VA^S) ^ finite space K^^^^^^ As such, all of its 
level sets are clopen, and thus factor through K^\-^^^'^) for some finite subset A of S. In other words, we 
can find a finite set A C 5 and a continuous map T^'''''' : X^I'"!'*'^) — > such that 

(f oA)(W)=t"'1^4^-» 

where vr^i : K'*'^ K'*'^ is the restriction natural transformation. If we then define the natural transfor- 
mation T : K^^ —fKhy requiring that 

for all vertex sets V and all e Inj([fc], V), one easily verifies that T is well-defined, is a deterministically 
continuous natural transformation, and that the diagram 





T 










f 


_ 


A 





(52) 



commutes. (The reader may wish to connect this diagram together with ( |45] ), with T again replaced by T 
of course.) In particular, (T, A) is a local modification rule in the sense of II .271 

Since T entails V, we see from ( |52] | and the surjectivity of it a that T also entails P. By chasing all the 
definitions we conclude that the local modification rule (T, A) also entails V. 

Now we turn to ( ISTT i. From d52] i and the structure theorem (Theorem |3.1| l we can rewrite this as 
Since the set here is clopen, and G„ o converges vaguely to we conclude that 

for all sufficiently large n. But the left-hand side can be rearranged using Definition 11.211 and Definition 
[E23as 

/ / l{T,{Gr,f''^\w)^Gr}^''^\w)) dvt{w)dv^{v). 

But this contradicts ( |50l ) (for n sufficiently large). This concludes the proof of (ii). □ 

In view of the above correspondence principle, the Theorems 11.51 11.61 11.71 11.81 now follow immediately 
from the following four infinitary counterparts respectively. 



49 



Proposition 3.46 (Every hereditary directed hypergraph property is testable). Let K be a finite palette, and 
let V be a hereditary K -property. Then V is infinitarily testable with one-sided error 

Proposition 3.47 (Every hereditary undirected graph property is locally repairable). Let K be a finite 
palette of order at most 2, and let V be a hereditary undirected K -property. Then V is infinitarily strongly 
locally repairable. 

Proposition 3.48 (Every weakly monotone directed hypergraph property is locally repairable). Let K be 

an ordered finite palette, and let V be a weakly monotone K -property. Then V is infinitarily strongly locally 
repairable. 

Proposition 3.49 (Every partite hypergraph property is locally repairable). Let K be an finite palette of 
order k> 1, and let V be a partite hereditary K -property. Then V is infinitarily strongly locally repairable. 

We will prove these four propositions in future sections, with the proof of Propositions 13.471 13.481 13.491 
being started in Section [34l after some preUminaries in Section [331 and Proposition 13 .46| being started in 
Section [33] For now, we reinterpret the negative results from Section|2]by indicating why infinitary strong 
local repairability fail^ for directed graph properties or undirected hypergraph properties of order < 3. 

3.2.1 Directed grapli properties are not infinitarily strongly repairable 

We begin by recasting the argument in Section [TTI in the infinitary setting. Let = C C R be the 
standard middle-thirds Cantor set consisting of numbers in [0, 1] whose base 3 expansion consists only of 
Os and 2s with Cantor measure Q\ — nc (which would be the law of a random base 3 string in [0, 1] 
consisting of Os and 2s); by Example 13.231 this induces a natural transformation Pi : pt — > ^<i. We 
set Z := (pt, Zi, {0, 1}) and k 2, and let P2 : Z<2 Z he the natural transformation defined by 
P^^\z) := X nee('') ^^'■^^^ ^^^^ F and z e Z^^, where Q({"^"'»(z) is the law 

of the directed graph G2 in {O,!}^^^'^"^^ defined by G2{v,w) := X{z{v) < z{w)) and G2{w,v) := 
I{z{w) < z{v)). Then ji := P2 o Pi is a regular exchangeable Z-recipe. We let K := {0, 1}2 and let 
K : Z ^ K he the colouring map which is the identity on the second component and trivial on the zeroth 
and first components. Then we easily check that k o ^ almost entails the {0, l}2-property V of being 
a total ordering (as in Section [2Tt . However, one cannot find any deterministically continuous natural 
transformation T : Z ^ K which entails V, because any Z-coloured hypergraph z G Z'^^ which has a 
pair V, w of vertices which are indistinguishable in the sense that zi{v) — zi{w) and Z2{v, w) — Z2{w, v), 
will necessarily map under T to a directed graph G € -ftT^^-* such that G2(w, w) = G2{'w,v), which impUes 
that G cannot obey V. Thus the {0, l}2-property V is not infinitarily strongly repairable. 

One can view the argument in Section 12.11 that shows that V is not strongly repairable as the finitary 
analogue of the argument above. (The much more complicated demonstration that V is also not weakly 
repairable does not seem to have an easily describable infinitary counterpart.) 

3.2.2 < 3-uniform hypergraph properties are not infinitarily strongly repairable 

Now let Zi = C U {R}, where C is the middle-thirds Cantor set and R is an abstract "red" point, and let 
Qi := + ^Sb., thus the red point has mass 1/2 and the Cantor set has total mass 1/2. We set Z := 
(pt, Zi, {0, 1}, {0, 1}) and k :— 3, thus by Example 13. 231 Qi induces a natural transformation Pi : pt ^ 

^■'The authors in fact discovered tliis failure at tlie infinitary level first, and only converted it to the finitary counterexamples in 
Section|2]afterwards, and with some non-trivial effort. 
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Z<i. We then define a natural transformation P2 : Z<i Z<2 by P2 (^) •= x nee(^) Q2 U)' 

where Q2'^'^^\z) is the law of the random graph in {0, llj^^'™-^-* which is complete with probability 1/2 
and empty otherwise if zi{v) ^ zi{w), and always empty when zi{v) — zi{w). We then define a natural 
transformation P3 : Z<2 Z hy P^^\z) :— x nee(*^') Q'sH^ te). where q'^\z) is the law of the 

random hypergraph in {0, Ijs'^'' which is empty unless e can be expressed as {r, b, b'} where zi(r) = R, 
zi(b) > zi{b') he in C, Z2{r, b) = 1, and Z2{r, b') — 0, in which case the hypergraph is complete. Then 
fi := o P2 o Pi is a regular exchangeable Z-recipe. If we let K :— (pt, {0, 1}, {0, 1}, {0, 1}), and let 
K : Z ^ Khe the colouring which is trivial on the zeroth component, the identity on the second and third 
components, and maps C to and R to 1 on the first component, one verifies that ko fi almost entails the 
i^-property V defined in Section l272l 

Now let V := {ri,r2, bi, 62} be an abstract set with four elements, and consider the Z-coloured hyper- 
graphs z e Z^^^ such that 

• zi{ri) = zi(r2) = R and zi(6i) = 21(62) e C; 

• 2:2(^1,61) = 22(^2,62) = 1 andz2(?'i,62) = Z2{r2,bi) = 0; 

• z is symmetric with respect to the morphism (p G Inj(V, V) which swaps ri and r2, and swaps bi 
and 62 ■ 

If T : Z ^ K is ci deterministically continuous natural transformation and G :— T'^^\z) g K'--^\ then 
we see that G is also symmetric with respect to the morphism mentioned above. If Gi — ki o zi and 
G2 =22, then we also have Gi(ri) = Gi(r2) = 1, Gi(6i) = Gi(&2) = 0, G2(ri, 61) = G2(r2, 62) = 1 
and G2(ri, 62) — G2(r2, 61) = 0. But this implies that either bi >G,ri ^2 and 62 >G,r2 bi are both true, 
or 62 >G,ri bi and bi >G,r2 ^2 are both true, which in either case is incompatible with T entailing V. 
Thus the only way that T can entail V is if we have Gi 7^ ki o zi or G2 7^ Z2 for all z £ Z^^-* of the above 
form. But this can be shown to be inconsistent with T obeying (l36T l for e sufficiently small, and so V is not 
infinitarily strongly locally repairable. 

One can perform a similar infinitary translation of the scenario in Section [231 we leave this to the reader 



3.3 The asymptotics of increasingly fine colourings 

Much of our analysis will revolve around the colouring of an infinite palette Z by a finite palette A; such 
colouring is roughly analogous to that of dividing the vertices (or lower-order edges) of a graph (or hyper- 
graph) into cells, as is done in the graph and hypergraph regularity lemmas. We will need a notion of a 
statement becoming asymptotically true for "sufficiently fine" colourings, similar to how a graph becomes 
increasingly regular as one partitions the vertices into finer and finer cells, or how a measurable function 
increasingly resembles a continuous one when viewed at finer and finer scales. In this section we set out 
some notation that will help us achieve these goals. 

Definition 3.50 (Colouring topology). Let Z be a sub-Cantor palette of order at most k. For each < 
j < k, we let Colj{Z) denote the collection of all finite a-algebras B of Zj that are generated by clopen 
sets, and let Col(Z) := 11^=0 ^olj(Z). Note that every colouring a = {aj)°^f^ : Z A generates an 
element Ba = {^aj )'j=o of Co\{Z), where Ba^ is the a-algebra of Zj is generated by the level sets of 
aj : Zj Aj. (The maps aj for j > k are trivial and thus of no consequence.) 
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We endow Co\(Z) with the topology whose sub-basic open sets take the form 



{{B,)%^ e Col(Z) : B, D ^^(^,+1, . . . , Bk)} (53) 

where < i < k and F : Coli+i(Z) x . . . x Colfe(Z) —>■ Coli(Z) is an arbitrary function. Thus a set 
is open if it is the union of sets which are finite intersections of sets of the form (I53l l. We make the simple 
but important observation that the intersection of finitely many non-empty open sets in Co\{Z) is again a 
non-empty open set. 

Let a : Z A be a colouring. A statement involving a is said to hold for sufficiently fine a if there exists 
a non-empty open set U C ColfZ) such that the statement holds whenever Ba € U. If c{a) G R is a 
real-valued quantity dependina^A on a, and Cqo is a real number, we say that c{a) tends to Coo as a — > oo, 
and write \mia^ oo c{q) = Cqo orc{a) ~ Coo+Oa-tooi^), if for every e > Q, the statement \c{a)—Coo\ 
is true for sufficiently fine a. 

Remark 3.51. Readers familiar with the hypergraph regularity lemma may recall that in order to usefully 
regularise a hypergraph of order k on a vertex set V, one must partition each of the edge classes (^) for 
^ l£ j l£ k into cells. Typically, the regularisation will only be useful if the partitions for lower values of j 
are sufficiently fine compared to higher values of j, as the lower order partitions are used to regularise the 
higher order ones. Our notion of sufficiently fine colourings in the above definition captures the infinitary 
analogue of this phenomenon. 



One can treat the limit a oo much like a sequential limit n — > oo. For instance, any finite linear 
combination of quantities which are Oq,^oo(1) is also Oq^oo(I)- More generally, we have 

Lemma 3.52 (Dominated convergence theorem). Let Z be a sub-Cantor palette, and let {X, i') be a prob- 
ability space. For each colouring a : Z ^ A, let Fa '■ X [—1,1] be a measurable function. If we 
have 

lim Faix) = (54) 

a — ^CJO 

for v-almost every x ^ X, then we have 

lim / Fa dv{x) = 0. 

Proof. By splitting F^ into positive and negative components we may assume that all the Fa are non- 
negative. Let £ > be ai^biti-ary. Since 




Fa dv{x) <e + u{{x e X : Fa{x) > e}) 



it will suffice to show that Fa converges to zero in measure, in the sense that E X : Fa{x) > e}) < e 
for all sufficiently fine a (depending on e). 

Since any sub-Cantor space has at most countably many clopen subsets, we see that the set Col(Z) is at 
most countable. We can thus find a sequence a„ of colourings whose associated cr-algebras Ba^, exhaust 
Col(Z). From this and the hypothesis ( l54l i. we see that 

oo 

v{P\{x€X: Fajx) > e}) = 0. 

n=l 

-^Technically, the class of all colourings on a given palette Z is not a set, so that c here is a class function rather than a function, 
but one can rectify this by any number of artificial expedients, for instance by forcing all palettes to take values in the set of integers. 
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By the monotone convergence theorem, we thus have 



N 



iyif]{xeX:F^^ix)>e})<e 



for some finite N. Taking a to be finer than ai, . . . ,aN, the claim follows. 



□ 



An important principle for us will be Littlewood's principle, which asserts that measurable functions are 
almost continuous at sufficiently fine scales. We shall need the following technical version of this principle. 

Lemma 3.53 (Littlewood's principle). Let Z be a sub-Cantor palette of order k > 0, and let a : Z ^ A 
be a colouring of Z. Let V be a finite vertex set, and let < j < k. Let H be a finite-dimensional Hilbert 
space, let fi G Pr(z£^'') be a probability measure, and let F : Z^^^^ H be a bounded measurable 
function; we allow H, /z, F to depend on aj+i, . . . ,ak,V, but they must be independent of ao , . . . , aj. For 
any a G C'a C Z^^"^ be the set Ca ■— (cE^*-^-')~^({a}). Then F is almost continuous on most 

cells Ca in the sense that 



F{w) d{y.\Ca){w) 



d{^Ji\Ca){z) = Oa^oo(l), 



H 



where the conditioning (/i|Ca) is defined in Appendix\A\ and we adopt the convention that the summand 
vanishes when ^i{Ca) — 0. 



Proof. Fix V, j, ctj+i , . . . , afc, which then fixes H, n, F, and let e > 0. It suffices to show that 



for all sufficiently fine aj . 



F(=) - / F(w) dMC,)(w) 



d{^l\Ca){z) < e 



H 



As the topology of Z^^' has a countable base of clopen sets, we can approximate the bounded measurable 
function F to within 0(e) in L^{ii) norm by a finite linear combination G of indicator functions of clopen 
sets. Then we have 

^ ^i{Ca) f \\F{z)-G{z)\\Hd{^,\Ca){z)^\\F-G\\L^^^)«e 
and similarly (by the triangle inequality) 



< £ 



SO by the triangle inequality again, it suffices to show that 

E Ma) I ,J\G{Z)- f Giw) difi\Ca)iw)\\H difi\Ca)iz) 



< e 



aeA[_ 



for all sufficiently fine aj . But by the nature of G we see that G will constant on all of the cells Ga if aj is 
fine enough. The claim follows. □ 
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3.4 Reduction of repairability to non-exchangeable repairability 



We need to prove three infinitary strong local repair result^^ namely Proposition 13.471 which addresses 
undirected graph properties; Proposition 13.481 which addresses monotone hypergraph properties; and 
Proposition 13.491 which addresses partite hypergraph properties. We shall deduce all three propositions 
from the following somewhat technical proposition that pertains to arbitrary hereditary hypergraph prop- 
erties, which, instead of constructing a deterministically continuous natural transformation T : Z ^ K 
that entails V, settles for constructing a single map U : A'^^ jyi^) on a very large but finite vertex set 
V, which satisfies the locality property OTI ) but not the exchangeability property ( l30b . More precisely, we 
have 

Proposition 3.54 (Non-exchangeable repair of hereditary properties). Let K be a finite palette of order 
k > 0, let V be a hereditary K-property, let Z be a sub-Cantor palette, let k : Z ^ K be a colouring, 
and let n : pt Z be a regular exchangeable Z -recipe such that k o fj, almost entails V. Then for any 
colouring a : Z A which refines k through a (as in Definition \3.14}l and any finite vertex set V , there 
exists a map U : A^^^ jyC^) which is local in the sense that for any W G V and any a,a' £ V with 
a lw= o,' iw, we have U{a) [w— U{a') [w, and which locally resembles a(^) in the sense that 

(So^)(W)(r!c/) > l-Oc.^oc^(l) (55) 

where flu C A^W) is the set of all b G A^^''^'> such that K^'^\U{a)) = a^^^'^^h) for all (/> e Inj([fc], and 
a G A^^^ with A^'^'^ (a) = b, and the expression Oq,_^oo(1) is uniform in the choice ofV. 

Remark 3.55. The fact that the error o^^oo (1) uniform in V is crucial for establishing testability prop- 
erties for general properties V. Without this uniformity, one would only be able to test properties that were 
equivalent to forbidding a finite number of induced hypergraphs. (We will eventually be generating this 
finite set V from the Alon-Shapira finitisation trick, Remark \3.40\ and as such there is no good control as 
to the size ofV other than that it is finite.) The need to pass from the finite setting to the infinite setting, 
but then back again to the finite setting, is somewhat analogous to the presence of several regularisations 
in the Alon-Shapira argument (it radically different scales; roughly speaking, the finest such regulari- 
sation corresponds to the infinitary framework here, but we still have to treat the remaining regularisations 
finitarily. 

In the remainder of this section we show how Proposition 13.541 implies the three infinitary strong local 
repair results. We begin with the repairability of weakly monotone hypergraph properties. 

Proof of Proposition \3.48\ assumins Proposition \3.54\ Let K be an ordered finite palette of order fc > 0, 
let V he a weakly monotone X-property, let Z he a sub-Cantor palette, let k : Z A' be a colouring, 
and let /i : pt ^ Z be a regular exchangeable Z-recipe such that k o n almost entails V, and let e > 0. 
Our task is to locate a deterministically continuous natural transformation T : Z ^ K entailing V which 
obeys (|36] |. Note (as observed in Remark [3.42l l that as T is deterministically continuous, the left-hand side 
of ( |36] | simplifies to 

a.(W)({zgz(W) :r(W)(z)^«;(W)(z)}). 

Let a : Z ^ Ahe a sufficiently fine colouring to be chosen later; note that for a fine enough we may 
assume that k ^ a o a for some colouring a : A K. We will find a deterministically continuous natural 
transformation S : A K entailing V with the property that 

(ao/i)(W)({6e : ^ ^^'""(fe)}) - o™(l). (56) 

-^Readers who are only interested in the testability result may skip ahead to Section |33] 
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Once we do this. Proposition [338] follows by setting T := S o a and taking a sufficiently fine. 

It remains to locate a natural transformation S with the required properties. We first use a finitisation trick of 
Alon and Shapira. Observe (from Remark [3.40b that if a deterministically continuous natural transformation 
S : A ~* K does not entail V, then there exists a finite integer N such that S^^^^\A^^^^^) (/_ "P^I^D. 
This integer iV ostensibly depends on S\ however, since A and K are both finite palettes, the number 
of deterministically continuous natural transformations S : A K which do not entail V is also finite. 
Thus (by enlarging N if necessary) one can make Y independent of S. In other words, there exist^ an 
TV = Na.k.v which serves as a certificate for V in the following sense: if S* : ^ ^ X is a deterministically 
continuous natural transformation such that 

then S entails V. 

Fix this value of N\ by increasing N if necessary we may assume N > k. Our objective is now to locate a 
deterministically continuous natural tranformation S : A ^ K that obeys (l56b and (l57b . 

Let V := [N]. We apply Proposition [334l to obtain a local map U : ^([^1^ -piW) obeying ( |55] |. 

We will now use U and the weakly monotone nature of V, to build the deterministically continuous natural 
transformation S : A^ K.'Ne first define the map S'^^D : A^^D -> ifd^D by the formula 

5([^l)(a) := /\ K^'^\U{a)) (58) 

0eInj([JV],[Af]) 

for all a G A '1^1', where the meet of ii'-coloured hypergraphs was defined in Definition 1 1 .401 (note that 
this operation is both commutative and associative). Since U{a) £ p(^) and V is weakly monotone, we 
see that (|57]i holds. 

The map S*'!^!^ is clearly Inj([A^], [A^])-equivariant; since U is local, S'^^^^^ is also. From this (and the 
assumption TV > fc) we see that S'^^^^^ extends uniquely to a deterministically continuous natural transfor- 
mation S : A K. 

Finally, it remains to verify (|56] |. From ( fSSl l we see that 

aeA(l"l),0eInj([fc],[Ar]):A(*)(a)=& 

for all b e A'-^^^l The claim ^ now follows from □ 
Now we turn to the repairability of undirected graph properties. 

Proof of Proposition \3.47\ assumins Proposition ^ .54\ By increasing k and adding some dummy palettes if 
necessary we can take k — 2. We then repeat the proof of Proposition l3.48l with K a finite palette of order 
at most 2 and V a hereditary undirected ii'-property, and let Z, k, fi, a, A, a, N be as in the previous proof. 
As before, our objective is to locate a deterministically continuous natural transformation S : A ^ K 
obeying (l56T l and ( ISTT i. The main difference is that we will use Ramsey theory instead of monotonicity to 
construct S. 

Let be a sufficiently large finite vertex set (depending on N, A, K) to be chosen later. We apply Propo- 
sition l3.54l to obtain a local map U : A^^^ V^"^^ obeying dSST l. 

-^Note however that this N is ineffectively finite, as one needs to solve a "halting problem" for V in order to compute it. 
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We now use Ramsey-theoretic tools to restrict [/ to a smaller vertex set on which one has more monochro- 
maticity; in these arguments we will rely crucially on the fact that k is equal to 2. 

Since U is local, we see that U uniquely defines a map Uw ■ ^^^^ ^ V^^^ C K^^'^ for all W C V, 
defined by requiring Uw{a iw) = U{a) [w for all a € A^^K Applying this with 14^ = we obtain 
a map J/g : v4o ^ Kq. Applying this instead with W — {v} equal to a singleton set, we obtain a map 
Uy : Aq X Ai ^ Kq X Ki. The number of possible maps Uy is finite, and so by the pigeonhole principle 
we can find a subset V' C V and a map Ui : Aq x Ai ^ Kq x Ki such that [/„ = Ui for all v G V. 
Furthermore, we can make V' as large as desired (depending on N, A, K) by making V sufficiently large 
(depending on N,A, K). 

We would like to perform the same analysis for doubleton sets W — {w, w}, but one runs into a difficulty 
that there is a Inj([2], ly) -ambiguity when trying to identify A^^^ (for instance) with Aq x A\ x A^. We 
shall rectify this by ad hoc combinatorial trickery when fc = 2 by exploiting the undirected nature of V, 
but the ambiguity is much more seriou^ when /c > 3 (even for undirected V) when one has to consider 
tripleton sets W = {u, v^w} or worse, and indeed as we see from Theorem ll.9l the analogue of Proposition 
I3.47l fails in this case. 

We turn to the details. Let M be a large number depending on iV, A, K to be chosen later If V (and hence 
V') is chosen sufficiently large depending on M, A, K, we can find disjoint sets Vag.ai in V for oq € Aq 
and fli e Ai such that | Vao,ai | > M. 

Suppose ao E Aq and ai,a'i E A\. Then we can define a map U^y : A2 K2 for any v e Vag^ai 
and v' e Vagy_^ by setting C/„.t,'(a2) :— [/{„ ,j/}(a)2(f , f') for all 02 E A2, where a E A^^""'^ is the 
undirected hypergraph defined exphcitly by 

aoO := ao;ai(l) := ai;ai(2) := a[:a2{l,2) = 02(2, 1) = 02. 

Now we crucially use the fact that V is undirected to conclude that Uy^y' ~ Uy\y. Thus Uy^y' can be 
viewed as describing a K2 ^-coloured graph Gao on the vertex set IJaieAi ^ao.ai foi" ^'^ch aq E Aq, and 
in particular defining bipartite graphs between Vag ai and Va^y^ when ai ^ a!^. Applying Ramsey's 
theorem (as well as the bipartite Ramsey theoreno) repeatedly, we thus conclude (if M is sufficiently 
large depending on N , A, K) that we can find subsets V^^ C VaQ,ai for oq E Aq and ai E Ai of size 

Kua,\^N (59) 

such that Gaa is monochromatic on V^^ x V^^ ^, for all gq E Aq and ai,a[ E A\ (not necessarily 
distinct). In other words, we can find maps Vag,ai,a\ ■ ^2 K2 for aq E Aq and 01,0^ E Ai with 

UaoMiM[ = C^ao.ai.ai SUCh that = Uaa,ai,a[ for all U E V;'o,ai ^d i;' E V^^^y^. 

Let us place an arbitrary total ordering < on K2, which in particular defines a minimum function min : 
K2 X K2 K2- We now define a deterministically continuous natural transformation S : A ^ K hy 
setting 

5(^)(a)o() :=C/o(ao) 
S^'^HaUw) :=C/i(ao,aiH)i 
S^^'>{a)2{w,w') := min(C/„„_„^(^)_a^(^/)(a2(w, w')),J7Qg_ai(«,),ai(«,')("2(w',w))) 

^^Specifically, the problem is that the colour in Ks that C/(a) assigns to a 3-edge {u,v,w} depends not only on the ver- 
tex colours ai{u), ai{v), a-i{w) 6 Ai and the 3-edge colour a-j(u,v,w) G A3, but also depends on the 2-edge colours 
a2{u, v), a2{v, w), 02(10, u) g A2, in a manner which may not be completely symmetric, even when V is undirected. Unsur- 
prisingly, it is this potential for asymmetry within an undirected hypergraph property which is exploited in Sections l2.2l and l2!3] 

-'See for instance 1 16 §1.2, 5.1] for statements and proofs of these theorems. These theorems can be deduced from Theorem 1 1.6 1 
by a slight modification of the arguments used to prove Corollary 1 1.381 but we of course cannot do so here as that would be circular. 
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for all vertex sets W and all a £ A^^^ . One easily verifies that S is indeed a deterministically continuous 
natural transformation. Now we verify If a e A^^D, observe (from ^5^) that we can find a morphism 
$ e Inj([A^], V) such that e V^'^^q for all n e [N]. Define the symmetrisation G G iCd^l) of 

any G S if^'^l-' by defining Go := Go, Gi :~ Gi, and G2("-, w) min(G2(?T., m), G2(m, n)) for all 
(n, m) £ Inj([2], [N]); in particular, G ^ G whenever G is undirected. By chasing all the definitions we 
see that 

for any b e A^^^ with A^*) (6) = a. Since [/ (6) obeys V and is thus undirected, we obtain (ISTl i as desired. 

Finally, we verify ( |56] |. Let b e A^I'^'l^ be drawn at random with law {a o and let G := ct'I*^!^ (6) € 

^([fc]) By (|55]i, we see that with probability 1 — Oq,^oo(1) we have 

K^'f'\U{a)) =G (60) 

whenever (f> £ Inj([fc], V) and a £ A^^^ satisfies A^'^^(a) = b; let us now condition on this event. Since 
U (a) £ V^^\ we conclude that G G T^d*^!); in particular, G is undirected. 

To prove ( |56] |, it will suffice to show that = G. In view of the definition of S, it will suffice to 

show that 

GoO = UM 
Gi{t) = Ui{bo,bi{t))i 

G2ii,j) = f/6o,&iW,b.O)(^2(«, j)) 
G2{iJ) = J^6o,&lW,bi(j)(^2(j,t)) 

for all distinct i,j £ [k]. But these claims all follow from ( |60] | and the definition of Ua, Ui, f^6o,bi(i),bi(j) 
by choosing (p appropriately. □ 

Finally, we establish the repairability of partite hypergraph properties. 

Proof of Proposition \3.49\ assumins Proposition ^ .54\ Once again we repeat the proof of Proposition l3.48l 
with K a finite palette of order fc > 1 and V a partite hypergraph iiT-property, and let k, /i, a, A, a, N 
be as in the previous proof. As before, our objective is to locate a deterministically continuous natural 
transformation S : A ^ K obeying ( |56] ) and ( fSTl ). In this case we will use partite Ramsey theory instead 
of Ramsey theory or monotonicity to construct S. 

Let AI be a large integer (depending on iV, A, K) to be chosen later. We let V :— [M] x Ai, thus W is 
the disjoint union of the sets Va^ := [M] x {ai} of cardinality M for ai G Ai. We apply Proposition 
13.541 to obtain a local map U : A^^^ —> T'^^) obeying (ISSl l. From locality as before, we also have maps 
Uw : A(^) ^ T'^^) for all W CV. 

Let < j < fc, and let £ Inj([j], ^i) be a morphism. For any vertices vi £ ■ ■ ■ ,Vj £ one 

can define a map U^-v,,...,v, ■ ^^'^'^ V'-^^^'^ by the formula 

where w : [j] — > {ui , . . . , } is the bijection that sends i to Vi for i G [j] . One can view this map as defining 
a j-partite j-uniform (T'^I-'l^)"^"^" -coloured hypergraph on the disjoint vertex classes , . . . , V0Q). 
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The number of j and ip are finite (and independent of M), and the size of the palettes 

are 

also finite and independent of M. Thus by applying the partite hypergraph Ramsey theorem (see e.g. 
lfT6l §5.1]) repeatedly, we conclude (if M is sufficiently large depending on N, A, K) that there exist sets 
V^_^ C of cardinality \V^_^ \ = N for all oi £ Ai such that all the partite hypergraphs mentioned above 
are monochromatic, or in other words that for every < j < A; and tp E lni{[j], Ai) there exists a map 
C/0 : ^([jD ^ T'd^D such that U^-,,,^...,,^ = for all vi e V^^,^,. V^^^y 

Fix the V^_^ and t/^. We now introduce the deterministically continuous natural transformation S : A K 
by defining S"*^^-* (a)^ (0) e ifj for vertex sets W, hypergraphs a £ A^^\ integers < j < A;, and 
morphisms (p E Inj([j], W) according to the following rule. If </) is a partite edge for a (thus the map 
di ° <l> ■ [j] ^ ^1 is a morphism) then we set 

5W(a),(</.) C/,,o0(A(^)(a)).-W; (61) 
otherwise, if <f> is not a partite edge, we set 

(a), a, (a, (0)). (62) 

One easily verifies that S* is a strongly natural transformation. Now we verify ( |57] i. Let a G yl^I^l^ be 
arbitrary. Since each of the V^_^ have cardinality N, we can find a morphism $ : [N] V such that 
G V;'^(„) for all n G [TV]. Let 6 G A^^) be any hypergraph such that A'*' (6) = a. By chasing all the 
definitions (and using the local nature of [/), we conclude that 

5([^l)(a),(0) = t/(6),($o0) 

for all < j < /c and all partite edges G Inj([j], [N]). By Definition [L 421 we conclude that 5([^l)(a) 
is partite equivalent to K^'^^{U{b)). Since C/(6) G p(^) and 7^ is partite, we obtain S^^^^^a) G V^^^^^ as 
required. 

Now we prove (|56]|. Let6 G A^l'^l^ be drawn at random with law (ao//)(W), andletG := ^(^^(6) G K^^''^\ 
By ( |55] |, we see with probability 1 — Oq^oo(I) that ( l60l l holds whenever G Iiij([fc], and a G A^^^ 
satisfies y4('^)(a) = b. Conditioning on this event, we conclude from (1611 1 and the definition of the that 
= o'j{bj{(t>)) whenever < j < k and (/> G Inj([j'], [k]) is a partite edge of b. Combining this 
with we obtain (ESll. □ 

To conclude the proof of all our main theorems, it remains to establish Proposition 13.461 and Proposition 
13.541 This will be the purpose of the remaining sections. 



3.5 Reduction to discretisations of the identity 

In the previous sections, we have reduced all of our testability and repair claims to two propositions, namely 
Proposition l3.46l and l3.54l In this section, we show how these propositions will follow from the following 
two propositions, which assert the existence of two different ways to approximate the identity natural 
transformation idz : Z ^ Z hy more discrete natural transformations that factor through a colouring 

a: Z ^ A. 

Proposition 3.56 (First discretisation of the identity). Let Z be a sub-Cantor palette of some order k > 0, 
and let ^ : pt Z be a regular exchangeable Z -recipe. Then for any colouring a : Z A there exist 
j -independent natural transformations Qa,j ■ Z^j x A>j Z<ij x A>j for each < j < k with the 
following properties: 



58 



( i) ( Qa.j only modifies the j component) For each a and each < j < k, the diagram 

Z^j X A>j ^"'^ > Z<_j X Ayj 



Z ^ j X A ^ j ^^^^^^^^ Z ^ j X A ^ j 
commutes, where the vertical arrows denote the obvious projection natural transformations, 
(ii) (Absolute continuity) For each a, every finite vertex set V, and every a € we have 

( Hi) ( Convergence to the diagonal) Given any finite vertex set V and any continuous function F : Z*^^^ x 
we have 

lim / (f F{z,z') (Q^,k0...oQ^,ooa)^''\z,dz')] dfi^''Hz)= [ F{z, z) dfi^^'Hz). 



Example 3.57. Let Z = (pt, Zi) and k = I for some sub-Cantor space Z\, and let fi G Pr(Zi) be a 
probability measure, which can be identified with an exchangeable Z-recipe by Example 13.231 Let a : 
Z ^ A be a colouring of Z, let Qo '■ A —^ A be the identity map, and let Qi : A ^ Z be the natural 
transformation defined by Qi^'' (a) := Il-uey Mai (v) for any vertex set V and a G A^^\ where we identify 
Z^^) with ZY and for any ai G Ai, & Pr(Zi) is the measure {p\Cai ) if ^JL{Cai ) > '^^^ M otherwise, 
where Ca^ := ai^{{ai\). Then one easily verifies that Qo,Qi obey the properties described above. 
Roughly speaking, the map Qi maps points z in Z\ to the uniform distribution on the A\-cell that z lies in; 
as the colouring a gets finer and finer, this map converges to the identity in a weak sense, which corresponds 
to the property ( Hi) above. 

Proposition 3.58 (Second discretisation of the identity). Let Z be a sub-Cantor palette of some order 
fc > 0, and let fi : pt ^ Z be a regular exchangeable Z-recipe. Then for any colouring a : Z A 
there exist a sub-Cantor space (which we view as a sub-Cantor palette of order Oj with a probability 
measure Va G 'Pv{Xa) (which we view as a natural transformation i^ct : pt — *■ X^), together with a 
deterministically continuous natural transformation : A x Xa —>■ Z, with the following properties: 

(i) (Asymptotic absolute continuity) The measure 

Ci^'^l) o ((a o ^) ® G Pr(Z(W)) 

is Oa—,ooi^)-obsolutely continuous with respect to /i'l'^l^ (see Definition \A.]2\ for a definition of e- 
absolute continuity). 

( ii) ( Convergence to the diagonal) Given any finite vertex set V and any continuous function F : Z^^^ x 

we have 

lim / / F{zX^/Ha^^\z),x))dvaix)d^i'■^^{z)= f F{z, z) dfi'-^^z). 
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Remark 3.59. The situation in the above proposition can be depicted by the following diagram, 

Z < Z X X„ A X X„ -^-^^ Z 

pt ^=^= pt ^=^= pt 
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informally speaking, the proposition asserts that the right map from Z x Xa to Z is asymptotically abso- 
lutely continuous and asymptotically convergent to the left map. 

Example 3.60. Let Z — (pt,Zi) and k — 1 for some sub-Cantor space Z\, and let /i G Vx(Z\) be 
a probability measure, which can be identified with an exchangeable Z-recipe by Example 13.231 For 
technical reasons we also select an arbitrary element of Z^. Let a : Z ^ A be a colouring of Z. For 
each Oi S Ai, we define the cell Cai '■= ({oi}), and draw C,ai G Zi independently at randomfor each 
a\ with law (/i|Cai ) /^(C'ai ) > 0, or with law 5z, otherwise. We then define the natural transformation 
C,a '■ A Z by setting Cl^c^^ (a) i{v) :— (^ai (v) for all vertex sets V, all a £ A^^-*, and all v € V; one easily 
verifies that this transformation obeys all the required properties; compare this construction with that in 
Example \3.57\ As we shall see in Section 13771 the situation becomes more complicated when k > \ due to 
the presence of "indistinguishable" pairs of elements o/ A^I-'l-' for 1 < j < k which are coupled together, 
which forces some modification to the above procedure of selecting each value ofC independently. 

In the rest of this section we show how Proposition 13 .461 follows from Proposition 13.561 and Proposition 
l3.54l follows by combining Proposition l3.56l with Proposition [338] 

Proof of Proposition \3.46\ assumins Proposition \3.56\ Let K he a finite palette of some order fc > 0, let P 
be a hereditary X-property, let Z be a sub-Cantor palette, letn-.Z^Khea colouring, and let /i : pt ^ Z 
be a regular exchangeable Z-recipe such that no fi almost entails V, and let e > 0. Our task is to construct 
a weakly continuous natural transformation T : Z K which almost entails V, and such that ( |36] | holds. 

Let a : Z ^ Ahe a sufficiently fine colouring of Z to be chosen later We apply Proposition l3.56l to obtain 
natural transformations Qaj ■ Z^j x A>j Z<j x A>j for < j < fc with the stated properties. We 
then define T — Ta : Z ^ K tohe the natural transformation 

T := K o Qa^k o . . . o Qafi o a. 

Since T factors through the natural transformation a : Z ^ A, and A is a finite palette, we see that T must 
be weakly continuous. Now we verify that T almost entails V. If y is a finite vertex set and z g Z'^^ then 
by Proposition l3.56t ii) we see that the probability measure T^^' {z) is absolutely continuous with respect 
to (k o '. Since k o ^ almost entails V, we see that p(^) has full measure with respect to (k o np'^' 
and hence T^^^ (z). The claim now follows from Remark [3.40l 

Finally, we need to verify (l36T l. Let F : Z^I'^l^ x ^ R be the indicator function 

F{z,z') :=X(k(W)(z) ^ k(W)(z')). (63) 

Observe that F is a continuous function which vanishes on the diagonal z — z', and so by Proposition 
I3.56t iii) we have 

for sufficiently fine a. But by chasing all the definitions we see that this is equivalent to (|36] |. □ 

Remark 3.61. Note that we did not use the full strength of Proposition \336\ in order to establish Proposi- 
tion \3.46] However we will need to exploit Proposition \3.56\ more thoroughly when establishing Proposition 
\154\ below. 

Proof of Proposition ^ .54\ assumins Proposition \3.56\ and Proposition \3.58\ Let i<ir be a finite palette of or- 
der fc > 0, let V he a hereditary iiT-property, let Z he a sub-Cantor palette, let k : Z ^ K he a colouring, 
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and let /i : pt ^ Z be a regular exchangeable Z-recipe such that k o /i almost entails V. Let e > 0. Our 
task is to show that if colouring a : Z — > A is a sufficiently fine colouring which refines k in the sense that 
K — a o a for some cr : A — > if , then for any finite vertex set V there exists a local map U : A'^^'> — > 
such that 

(ao/i)(W)(f7t/) > l-£. (64) 

Let a be as above. As in the proof of Proposition 13. 461 we let F : Zd*^!) x Z^*^!) ^ R be the indicator 
function ( |63] |. If a is sufficiently fine, then by Proposition 13 . 5 8 1 we can find a sub-Cantor space Xa with a 
probability measure : pt and a deterministically continuous natural transformation Cq, : AxX^ 

Z with 

/ F(z,(Cao(a®i^a))(^)(z)) <e/3 (65) 

such that the ci''^'"' ° ((So fi) © is e/3-absolutely continuous with respect to /i'^I'^l). By Proposition 

IA.13I we can find a compact set Ea C A'l'^l) x Xa such that 

((So/i)ei.„)(W)(i;„) <e/3 (66) 

and 

1^ oX(£;^)((a o /i) e z/„)(W) « ^(W). (67) 

Now let V be an arbitrary finite vertex set. We let a' : Z ^ A' he another colouring (it will depend orf°l 
V and a) to be chosen later We apply Proposition [336] to obtain j-independent natural transformations 
Qa',j '■ Z^j X A'>j Z<j X A' yj for < j < k with the stated properties. 

For each —1 < j < k in turn, we use the Qa'j to construct random local maps C/<^ : ^'l^' — > Z^j' 
recursively as follows. The map C/<_i : pt ^ pt is of course the trivial map. Now suppose recursively that 

< j < fc and the local map U'^^ := U'^j_^ : ^<i^ already been chosen. For any e G (^), 

the local map U'^j then induces a map ?7^j ^ : — > ■ '■'^^'^ randomly select, independently for 

each e, a map t/^^ ^ : ^'<] ^ Z<j'' by choosing U'^^ ^(a) independently at random for each a e ^'<] 

with law Qa/^ jiU^jJa^j), ttj), where a<j S ^'<] and Oj € ^'=] = ^'>] ^'"^ '^^e components of a. 
From Proposition l3.56f i). we see that we almost surely have the commutative diagram 



(68) 



^<J.^ ^ 7(e) 



where the vertical arrows are the obvious projection maps. We now condition on this probability 1 event 



We then define the local map [/< : A'')^^ to be the unique local map whose restrictions to each 



e e (^ ) are given by ^\ the condition (l68T l (and the local nature of C/<j) ensures that the local map 
U'^j is well-defined. 

By the j-independent nature of the Qa' ,j (see Definition 13 . 3 II and Proposition l3.56r i). we see by induction 



on j that for any —1 < j < k and any a e ^ly^ the random variable U'^,^{a) G ^<^'' is distributed 



'"This introduction of a second colouring has an analogue in (5], 0, in which one uses a fine Szemeredi partition to decide how to 
colour a coarse Szemeredi partition. 
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with law Q<j (a), where Q<j : A<j Z<j is the unique natural transformation obeying the commutative 
diagram 

Q„, .o...oQ„, 

A > Z<j X Ayj 



(69) 



~ > Z<j 



where the vertical arrows are the obvious projection natural transformations. Applying this with j = 
k, we conclude that for any a G A'-^\ the random variable U'^f.{a) S Z*^^) is distributed with law 

iQa',k o • • ■ o Qa',oY-^^ (a)- In particular, we see from Proposition l3.56r ii) that the distribution of C/^jt i'^) 
is absolutely continuous with respect to fi^^\ Since ko// almost entails V, we conclude that k^^'^''' o?7^^(a) 
obeys V almost surely. In other words, we see with probability 1 that the map k*^!*^'^ o U'^^. maps (A')*^^) 
toV'^^l We now condition on this probability 1 event. 

We choose a; £ Xa at random with law (independently of all previous random choices), and define the 
(probabilistic) map U — Ux '■ A^^^ —> by composing together the chain 

^(V) idxx^ ^(v) ^ CL''> ^ ^^v) . . ^(y) . ^(V) (70) 

or in other words by the formula 

U4a) (75(^) o (7^^ o^'''^ o Cr))(a,x) (71) 

for all a e A'^^l 

By construction we see that (with probability 1) does indeed map A^^^ to 7^'^^; since ?7^j. is local 
and K, a', (a are deterministically continuous natural transformations, we see that Ux is also almost surely 
local. To establish the claim (l64l i. it thus suffices by the probabilistic method to show that 

E(ao/i)(W)(17c/J > 

Accordingly, let us select b £ ^d*^!) at random with law (a o /i)*^!*^!). By (l66b . we see that (6, x) ^ Ea 
with probability at least 1 — e/3. Also, by ( |65] ), we see thatCT(['=l)(6) = (ko C„)(['=l)(6,a;) with probability 
1 — e/3. Thus it suffices to show that the event 

{b,x) ^ Eo, K^'^\Ux{a)) ^ (koCc.)''''!^ (5, x) for some e lnj([fc],y) and a G A^^' with A^"^) (a) = b 
has probability at most e/3. 

Fix e Inj ( [/c] , V^) ; by the union bound, it suffices to show that the event 

{b,x) ^ Eo, and K^'>'\Ux{a)) ^ {no Caf^^'^\b,x) for some a G A^^^ with A^'''\a) = b 
has probability at most e/3 1 Inj ( [fc] , y ) | . 

Write z := c!;^^^\b,x), a' := ^'''''^(z), and e := 4>{[k]). From dzB (or dTOll) we see that 

if W(f/(a)) = ^(['^'1) o Z(^) o {/^^^^ o {A')^^'"\a') 

whenever a £ A*^) is such that A^"*) (a) = 6, where f7<j. : Z^'^) is the localisation of the local 

map U'^f. : Z^^\ Thus, if we write z' := U'^^ ^ o (A')('^"')(a'), it suffices to show that the 

event 

(6, x) ^ E^ and k^^^ (z') 7^ Tt^ (z) 
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has probability at most e/3| Inj([fc], By (1631 ). it thus suffices to show that 

E(X((M)^i.„)F(.,.'))<^^-(^. (72) 

Recall that for any a e vl^^', the random variable U'^^.{a) £ Z^^^ is distributed with law {Qa>,k o ■ • • o 
Qq./.o)'^-' (a). This implies for fixed a' that z' is distributed with law {Qa',k o • • • o Qa',o ° a')'-'*''!' (z). Thus 
we can write the left-hand side of ( |72] | as 




where fa' : Z^^^ [0, 1] is the measurable function 

U'iz):= f F{z,z'){Qa',k0...oQa-,oo^Y^'''^\z,dz') 
and is the finite measure 

:=ci['i)°i(i?S)((so/i)©^^a)"'=". 

Now, by Proposition l3.56f iii), we have 

lim / V^'H^) = 0; 

thus (by Markov's inequality) fa' converges in measure to zero with respect to fA^^ as a' oo. On the 
other hand, from ( |67] i we see that fia is absolutely continuous with respect to fi^^K By Proposition |A.13l 
we conclude that fa' also converges in measure to zero with respect to and so 

lim / fa'iz) d^aiz) = 0. 

Thus, by choosing a' sufficiently fine depending on a, V, e, we obtain ( |72] | as required for every choice of 
0. □ 

To complete the proof of our testability and local repair results, it suffices to prove Proposition 13.561 and 
Proposition |3.58l This is the purpose of the next two sections. 



3.6 Proof of Proposition 13.561 

We now prove Proposition [3361 Let Z, k, /i, a be as in that proposition. By Definition (334] we can factor 

/X = Pfe o . . . o Po 

where for each < j < k, Pj : Z^j Z<j is a j -independent natural transformation such that 7r<joPj = 
idz^j, where 7r<j : Z<j Z^j is the projection natural transformation. From Definition 13.311 we 
conclude that 

P^''\z) ^S.x Q^P[z) = <5. X [] Qf {z U) (73) 
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for all vertex sets V and all z € some j -independent natural transformation Qj : Z^j — > Z^j, 

where we identify z'^j' with Z^Y^^ x nee(^') ™ obvious manner 

Suppose that e is a vertex set of size |e| = j, z G ^<j, and a G We define the cell Ca C Z^j 

associated to a by the formula 

Ca {a^:]r\{a}) = {z e Z^j : a,(z(<^)) = a(<^) for all G Inj([j], e)} 

and then define the measure i^e.z.a G Pr(-Z^£j ) to equal the conditioned measure iQfiz)\Ca)(iis defined 
in AppendixlU if Q^''\z){Ca) > 0, or Q\''\z) otherwise. 

We then define the natural transformation Qaj ■ Z^j x A>j Z<j x Ayj by the formula 

for all vertex sets V and all z<j G G A'^Jj', a>j e ^>^\ where we identify Z^^^ x A^^^ with 

^<^^ X aL^' X A'^y^ and Z^-^^ x A^^^ with Z^^^ x DeeCf) ^ '^>^^ ^" obvious manner Note that 
we can factor Qa,j = Q' a j ® ^^A^,, where Q'^ ^ : Z^j x A=j Z<j is defined by 

Q'ij-(^<j>aj) := X W v^,z^,u,a,u- (75) 
(Compare this with Example l3.57l ) 

One easily verifies that Qa.j is a natural transformation, is j -independent, and obeys claim (i) of Proposition 

13.561 Also observe from construction that Ve,z.a is absolutely continuous with respect to Q^^iz) for all 

< J < fc, |e| = z G Z^^], and a G A^!]. By (|73ll, and Lemma IaTT] we conclude the absolute 
continuity relationship 

for all finite vertex sets V, all < j < k, and all z<j G ^<^'', a=j G ^i!^^' '^>j ^ ^>i^- Iterating this 
using Lemma lA.llI we obtain claim (ii) of Proposition l3.56l 

It remains to prove claim (iii) of Proposition 13. 561 which is the most difficult estimate. The key tool will 
be Littlewood's principle (Lemma 13.531 1. For inductive reasons we need to prove the following rather 
technical statement. For any — 1 < j < fc, we introduce the exchangeable Z<j-recipe /i<j : pt Z<j by 
the formula 

H<j := Pj o . . . o Pq 

and the natural transformation T<j : Z<j Z<j to be the unique natural transformation such that 
where iTz^z<_j and T^z<_j>iA>j^z<j are the projection natural transformations. 

Lemma 3.62 (Convergence to the diagonal). Let the notation and assumptions be as above. Let V be a fi- 
nite vertex set, let —1 < j < k. Let H be a finite-dimensional Hilbert space depending on a^+i, . . . ,ak,V 
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but independent of uq, . . . , aj, and let F : Z^^^ H be a bounded measurable function which can 
depend on aj+i , . . . , ak,V but is independent o/ao, . . • , aj. Then 



\\F{z)~F{w)\\HT^/,\z,dw) 



(76) 



Proof We induct on j. The case j ~ —lis vacuously true, so suppose that < j < k and that the claim 
has already been proven for j — 1. 

Fix V, H, F; we may normalise F to be bounded in magnitude by 1. It is convenient to use the language 
of probability rather than measure theory. Let z G ^<j^ be drawn at random with law /i<^\ and then for 
fixed z, let w be drawn at random with law T^'' (z). Our task is to show that 

E||^^(z)-FH||h =o„^oo(l). (77) 

We split z — {z^j,Zj) and w ~ {w<^j,Wj) for z^j,w^j G z'^j^ and Zj,Wj £ ^j^''- We similarly split 
a := cx<j'^^\z) € ^<j^ as a = {a^j,aj). Observe from construction that 



• z^j € z'^j' has the distribution of /i^^ 

• Given z<j, a<j is determined by the formula a 



<3 ^ "</^n^<j); 



• Given z<j, z is a random variable with law Pj^^ {z<j)', 

• Given z, aj is determined by the formula aj = cEJ*-^-* (zj); 

• Given z<j, w<:j is a random variable with law T^-^_^{z^j); 



• Given w<j and aj, w is a random variable with law Q'^ ■ (w^j , aj) (defined in dTSl)). 

Now we write the left-hand side of dTTj i as 

J2 EiIia,^b)\Fiz)-F{w)\) 



and estimate this using the triangle inequality as the sum of the three expressions 

J2 E{J{a,=b)\\F{z)-G,{z^,)\\H) 



heA 



(V) 



and 



=j 

^ E(X(a, =&)||FH-G,(z«<,)||h) 



(78) 



(79) 



(80) 



65 



where Gb ■ ~> H is the measurable function 

Gb{z<,) / F{z) Qf]iiz^,,b),dz). 

We will show that each of (|78]l, dlSli, dSOll are Oa^oo (1). 
By the induction hypothesis we have 

E X! \\Gb{z<j) - Gb{w<:j)\\H ^ Oa^ooil) 
and so the contribution of ( |79] l is acceptable. 

Now let us look at dTSl l. In view of the distribution of z<j and z, we can rewrite this expression as 
E/q,^ (z<j), where where 

beA%:' 

and 

where we can of course ignore all summands on which pJ^''(z<j)(Ch) = 0. By Lemma [3.53l fa^ {z<j) = 
Oq->oo(1) for each z<j. Applying Lemma [3.52l we conclude that ( iTSl l is Oa^oo(l) as desired. 

Finally we look at jSOl l. For each bj G l^t rif,j C ^<^^ be the set of all z<j such that the event 

{aj = bj} has non-zero measure with respect to Pj^^^ {z<j)- We split (ISOl l further into 

5^ E (X(a, - 6,m^«<j e f^b,)||i^M - Gb,{w^j)\\H) (81) 

and 

5] E {I (a, - 6,)I(^"<. ^ ^b,WH - GbAw<j)\\H) (82) 

Consider the expression JSTT l. If w^j E O and = bj are fixed, then Wj has the distribution of /i^,^ , 
where /iu,<j was defined in the treatment of ( TTSI ). Thus we can bound dSTT l by 

By the induction hypothesis, we have E|/c (i(j<j) — fa-{z<j)\ — Oq_+oo(1), and so the contribution of 
dSTT l is acceptable by our analysis of ( fTsT l. 

Finally, we turn to ( l82b . As F is bounded in magnitude by 1, we may bound this expression crudely by 

By the induction hypothesis we have 

2 ^ E|X(w<j ^r!bJ-J(z<j ^r^bJl =o„^oo(l) 



{PP{z^„dy)\Cb) 
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so it suffices to show that 

But if z<j e 51^ then has a zero probabiHty of equahng bj, and so the left-hand side is zero. The claim 
follows. □ 

Now we prove Claim (iii) of Proposition [3361 Observe from the Stone- Weierstrass theorem that we can 
approximate any continuous function F : Z^^^ x Z'^^ — > R uniformly by finite linear combinations of 
tensor products f{z)g{z'), where / : Z*^^^ R and g : Z'^^ — > R are continuous. By linearity, we may 
assume that F itself is of this form; thus our task is to show that 

lim / f{z)([ g{z')Tg\z,dz')) dpi^''\z)= f f{z)g{z)df^^''\z). 

By the triangle inequality, it suffices to show that 




But this follows immediately from Lemma 13.621 The proof of Proposition 13.561 (and thus also Theorem 
11.5b is now complete. 



3.7 Proof of Proposition 13.581 

We now prove Proposition l3.58l which is the most difficult proposition to establish in this paper. In Example 
13.601 we already saw how the k — 1 case of this proposition proceeded. Unfortunately, this case does 
not capture the full complexity of this proposition, as it does not reveal the difficulty of dealing with 
"indistinguishable" pairs of inputs. To illustrate the problem, let us informally consider a model case in 
which k = 2, Z — (pt, Zi, {0, 1}), and fi ^ P2 o Pi where Pi : pt ^ Z<i is given from a probability 
measure Qi £ Pr(Zi) as in Example 11231 and P2 : Z<i ^ Z takes the form P^^\z) = x Q^^^(^) 
for some deterministic natural transformation Q2 : Z<i Z=2- We wiU also assume that A2 = {0, 1} 
and that 02 : {0, 1} {0, 1} is the identity. 

We can view the deterministically continuous natural transformation (a '■ A x Z as a random 

deterministically continuous natural transformation C, : A ^ Z. Such a natural transformation can be built 
out of two functions (i : A^'^'^ ^ Z^S\^^ and C2 : ^^'^'^ ^ Z^jf' by requiring that 

C([-'"»(a),(0) = 0(a)(0) 

for j — 1, 2, a e A^I^l), and (j) e Inj([j], [j]). Any two functions (i, C2 will determine a deterministically 
continuous natural transformation, so long as (2 is Inj([2], [2])-equivariant. On the other hand, to get 
the convergence to the diagonal, we would like to have af!^'''(Cj(a)) — aj for all j = 0, 1 and "most" 
aj e A'I^I) (with respect to the measure ao yu*^'^!'). We also need to select the ^ (a) in a suitably "absolutely 
continuous" manner. 

We build and (2 as follows. For each ai £ Ai = A^^^^\ define the cell Ca^ '■— Q;j~^({ai}), and select 
Ci (ai) € Zi^^'' independently at random with law {Qi\Cai ) if Qi (Ca^ ) > 0, and with law Qi otherwise; 
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this already ensures that ai o d converges to the diagonal (by Littlewood's principle). Then, we can define 
C2 by C2(a) := (32 (Ci ° o-i)- Note that as long as 1 and 2 are distinguishable in the sense that ai(l) 7^ 
ai(2), the distribution of d o ai G Z\ will be absolutely continuous with respect to Q\, as Ci(ai(l)) 
and Ci(a2(2)) are independent and individually absolutely continuous with respect to Q\. The required 
absolute continuity and convergence properties would be relatively easy to establish if the distinguishable 
case was the only case. However, in the indistinguishable case a\(X) = ai(2), the random variable Ci o ai 
is no longer absolutely continuous with respect to Qi, being concentrated on the diagonal of Zf (which 
can have zero measure), and so convergence and absolute continuity in this case is not immediately clear. 
To resolve this issue, observe that if Zi is atomless with respect to Qi then this indistinguishable case will 
be asymptotically negligible for sufficiently fine Ai; on the other hand, if Zi does contain atoms, then the 
diagonal of Z^ acquires a positive measure with respect to Q^, and so the difficulty again disappears. Note 
however that our analysis had to take note of what symmetries were obeyed by the input a. Later on we 
shall see that we will need to describe these symmetries in general by a certain groupoid Ra- 

We now begin the full proof of Proposition [338] Let Z, k, n, a be as in that proposition. To simplify the 
notation slightly we shall omit some subscripts on a. By Definition [334] we can factor 

where for each < j < k, Pj : Z^j Z<j is a j-independent natural transformation such that 

^z<,^z<,°P, =idz<,. (83) 



Our objective is to find a probability sub-Cantor space {X, v) and a deterministically continuous natural 
transformation C, : Ax X ^ Z such that 

is OQ._,oo(l)-absolutely continuous with respect to /i^I'^'l^ and which converges to the diagonal in the sense 
that 

lim / / F{zX'''^\oi^^\z),x))dy{x)dii^^\z)= f F{z, z) dn^^\z) (84) 

for all finite vertex sets V and all continuous F : Z^^^ x Z^^' — > R. 
This will follow from the j — k case of following inductive proposition. 

Proposition 3.63 (Inductive discretisation). For any — 1 < j < fc, die re exists a probability sub-Cantor 
space {Xj, Vj) and a deterministically continuous natural transformation C<j : x Xj —t Z<^j such 

(85) 



that 



for all finite vertex sets V, and for which we have the convergence property 



{V) 



lim 

ft — 'OO J y{V) 



\\F{z)~F{w)\\HT^<^{z,dw) 

.{V) —J 



(86) 



for all finite vertex sets V, all finite -dimensional Hilbert spaces H, and all bounded measurable F 



7{V) 

'<3 



H, where T. 



Z<j is the natural transformation 

II <j : pt — !■ Z<j is the exchangeable Z<j-recipe 

l^<] Pj° - --o Po, 

and we allow H, F to depend on aj+i, . . . ,ak (but must be independent of uq, . . . , aj). 
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Indeed, to establish ( l84b from the j = k case of ( l86b one repeats the arguments at the end of the previous 
section. 

Remark 3.64. It will be more convenient to interpret ( 1861 ) probabilistically, as the assertion that if V is a 
vertex set, F : Z^^^^ —>■ H is a bounded measurable map into a finite-dimensional Hilbert space, z G z'^^ 
is drawn at random with law M^'', x G Xj is drawn at random with law Vj, a :— a<y^^' {z) G ^<^''> owcf 
w :— ^^j\a, x), then 

E||F(z)-FH||h = o„^^(l) (87) 
where the decay rate Oa^oo depends of course on F and H. 

It remains to prove Proposition l3.63l The case j = — 1 is trivial, so suppose inductively that < j < k and 
that the claim has already been proven for j — 1. To simplify the notation slightly we shall just consider the 
case j = k; actually, we can reduce to this case by discarding all components of Z, a, A of order greater 
than j, and then reducing kio j. 

Henceforth j = k. Let {Xk_i,Vk_i) and C<fc :— C<fc-i be given by the inductive hypothesis. 
3.7.1 Construction of Xf. and C<fe 

Let S denote the collection of all Inj([fc], [fc])-equivariant maps f : A^I'^l^ ^=fc observe that S is a 
compact subset of [z^jP)^''^ " and is thus a sub-Cantor space. We refer to elements ^ of S as k-rules. 

We set Xk :~ X^-i x S, and let C<fe : A x Xk Z he the unique deterministically continuous natural 
transformation with the following two properties: 

• (C<fe extends C<fe) We have the identity 

7rz^Z<fc o C<A; = C<k o T^AxXk^A^k xXfc_i 

where ttz^z^^ ■ ^ ^ ^<k and nAxx^-^A^^xXk^i : Ax Xk ^ A<fe x Xk-i are the projection 
natural transformations. 

• (C<fc extends ^ We have 

CfJ\a,{x,0)k:^Cia) 
for all a G A^W), x G Xk-i, and ^ G S. 

More explicitly, C<fc is given by the formula 

Cfj((a<fe,a,.),(x,0) := (^c'^,\a^k, x), (^it"^(e(A(^=Ha<,, a,))))^^^^^) 

for all vertex sets V, all (a<fe,afe) G A'^-' = x A'^^i^, all x G Xk, and ^ G S, where for each 

e G (^), 0e is an arbitrary morphism from [k] to e (the exact choice of morphism is not relevant, thanks 
to the Inj([fc], [fc]) -in variance of £), and where we identify Z*^^) with z'^j} x nee(^) ^=1- easily 
verifies that C<fc is a deterministically continuous natural transformation. 
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3.7.2 Construction of 



To construct the measure i/k G Pr{Xk) we will need some more notation. 

Definition 3.65 (Invariant space, stabiliser, indistinguishability). Let Y be a sub-Cantor palette, and V, W 
be vertex sets. 

• IfG < lni(y, V) is a group, we define the G-invariant space (yf^))'^ := {y e y'^' : Y^'^'>{y) = 
y for all (f) e G}; this is a compact subspace ofY^^\ 

• If y e Y'^^\ we define the stabiliser stab(j/) := {(f) G Inj(y, V) : Y'-'^^{y) = y}; this is a subgroup 
o/Inj(l/,n 

• We say that two elements y € Y^^\ y' £ y(^) are indistinguishable if there exists an invertible (j) G 
Inj(y, W) such that y^"^) (y) = y' (in particular, this requires V and W to have equal cardinality), 
and distinguishable otherwise. 

Remark 3.66. Note that deterministically continuous natural transformations are forced to map indistin- 
guishable elements to indistinguishable elements. In particular, the images of indistinguishable elements 
cannot be set independently. This lack of independence will cause significant technical difficulties in our 
arguments. A similar difficulty will also be caused by the fact that deterministically continuous natural 
transformations must map G-invariant spaces into G-invariant spaces (or equivalently, they cannot de- 
crease the stabiliser of an element). 

Definition 3.67 (Vertical ingredient). We define Q : Z<fe —t Zk to be the unique natural transformation 
such that 

5,xQ(''\z):^P^^\z)- (88) 
for all vertex sets V and all z G Z^^f} ; this is well defined from ( I83l l. 

Definition 3.68 (Cell). If V is a vertex set, G < Inj(y, V) and ak G ^2^'', we define the cell 

Cv,G,ak ■■= {z G : = afe}; 

this is a compact subspace of . 

Definition 3.69 (Default point). We arbitrarily select a default point z„ G Zj,. For any V, we define 
G z'-p by setting z:^^\(l)) := z^forall(j3£ Inj([fc],y). 

Remark 3.70. The point is only needed for technical reasons, as a sort of "error message " to output 
when certain inputs are "bad". The exact value of z^ plays no role in our arguments. 

Definition 3.71 (Quadruples). If V is a vertex set, G < Inj(V, V), ak G A'"^, and z<fe G z'"^, we say 
that (y,G,afc,z<fe) is good if Q^^"^ {z^k){Gv,G.ak) > 0, and bad otherwise. We define the probability 
measure pv,G,ak,z^k ^ ^'^{{^P)'^) equal the conditioned measure {Q^^\z.(^k)\Gv,G.ak) (^^ defined 
in Appendix^ if (V, G,ak, z<^k) « good, and S^(v) otherwise. 

By using the natural transformation properties heavily, we observe that the probability measures pv.G,aj .w^j 

are invariant under relabeling in the sense that for any G < Inj(y, V), aj G w^j G ^<^\ and any 

bijection (j) -.V ^ W, that 

^<^G0-i,AL*>(a,),Z^'^'(^<,) = ° PG,a,.,w^, ■ (89) 
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Definition 3.72 (Random fc-rules). If x £ X^k, we define rjx € Pr(2) to be the unique law for a random 
k-rule ^ G S with the following properties: 

• For eacha = (a^k,o.k) G A^'^'^^\ the random variable a) € Z^'^^ has the law of p,,, , , ^ 

• If ai, . . . , a„ g ^(['^D are pairwise distinguishable, then the random variables ■f(ai), . . . , ^(a„) S 
■^=fc ^ are jointly independent. 

Remark 3.73. The probability distribution rjx can be constructed explicitly as follows. The equivalence 
relation of indistinguishability partitions A*^!*^!) into finitely many equivalence classes. For each equiva- 
lence class O, select a representative a £ O arbitrarily, and draw ^ (a) independently at random with law 
P[k],st!,h{a),a^,c"f{a^k,xy Then for any (j) G Inj([fc], [fc]), we set £_{A^'>''^ {a)) := Z^J^i^ia)). One easily 
verifies (using iS9i } that this defines a random k-rule ^, and that the law rj^for ^ has the desired properties; 
it is also easy to see that this law is unique. 

With all these definitions, we can now define the measure i^<fc e Pi{Xk) by the formula 

iy<k ■= 4 X rjx dv<k{x). 

Informally, z^<fc is the law of the pair {x, ^), where x G X^-i is selected with law v^k, and then ^ e S is 
selected with law rj^. 

Remark 3.74. When fc = 1, the construction simplifies substantially since it is not possible for two distinct 
elements o/ A'-I^l-' to be indistinguishable, and one essentially obtains the construction in Example \3.60\ 

It remains to verify the properties (l85T l. (l86] l (with j = k). 



3.7.3 Most quadruples are good 

The first task is to show that the bad quadruples (which output the "error message" z*) are negligible. 

Proposition 3.75 (Most quadruples are good). Let z G Z^^'^^^ be drawn at random with law let 
a — (a<fe, flfc) :— c?'''''^ (z) G A^^''^\ and let x G X^-i be drawn independently at random with law Vk-i- 
Let w<^k '■= C<fc ''('i<fei x) G .Z^^fe ^- Then the quadruple ([fc], stab(a), Ofe, w^k) is good with probability 

1 - Oq^oo(I)- 

Proof. The key idea of the proof is to exploit the fact (essentially arising from the monotone (or dominated) 
convergence theorem) that most elements of the cells Cv,G.ak tend to inherit the symmetries of their colour 
Ofc when the colouring a is sufficiently fine. 

By Definition 13.7 II our task is to show that 

P(Q"'lH^<fe)(C[fc],stab(a),aJ = 0) = O„^eo(l). 

The number of possible stabiliser subgroups stab(a) < Inj([fc], [fc]) is bounded (independently of A or a), 
so it suffices by the union bound to show that 

P(stab(a) = GandQ(W)(u;<fe)(qfc]^G.aJ = 0) = o^^^{l) 
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for each fixed group G < Inj([fc], [k]). 

Fix G. If stab(a) = G, then a e {A^^'^^^)'^; thus (by the natural transformation properties of ^<fe) we see 
that w<fc lies in (Z^'^'"*)*^. From this and Definition l3.68l we see that 

where for any b G A^^'^ C Zd'^^D is the set 

a:=z(W'x(ar^(W))-i({6}). 
From this and Definition l3.67l we see that 

Q"'=i)(^«<.)(q.],G,aJ = "(i«<fe)((^"''^")^ n 

so it suffices to show that for every e > 0, we have 

P(stab(a) = G and Fa^ (w<fc) = 0) < e 

for all sufficiently fine a (depending on e), where for any b G Z^£i^\ Fi, : Z^^j^ [0,1] is the measurable 
function 

F,{y) :=pf"(z/)((z(W)fnCO. 

Fix e, and set 5 :— £/|A^^''|. Observe that 

I{Fa,iw<k)^0)< J2 ]\Fbiw<k)~Fb{z^k)\+IiFa,iz^k) <6). 

From the inductive hypothesis (l86b (or (|87] |) we have 

E ]\Fb{w<k) - Fb{z<k)\ ^ e 

for sufficiently fine a, so it suffices to show that 

P(stab(a) = G and Fa, (z<fc) < 5) < e. (90) 

Recall that z<fc is distributed with law and for fixed z^k, Zk is distributed with law P^'*^'^ {z<k)- In 

particular, for any 6 S ^ij^'^ and fixed z<fe, we have ofe = b with probability Pfe''''''(y)(C^). Thus we may 
express the left-hand side of (|90] l as 

E J2 Pk''^\z<k){Ci)I{8tBh{a^k,b) = G)I{Ft{z^k)<S). 

1) 



We can split 
Since 



E J2 Fb{z<kmFbiz<i,)<5)<\A'if\d^e, 
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it thus suffices to show that 

E J2 ^'i""(^<fe)(a\(^"'")'')I(stab(a<fc,6) = G) « s. 

Now observe that if stah{a^k, b) — G, then on the support {z^k} x of P^''^'-' (z<fe), the set is 

contained in the set Thus we have 

Y: Pi['=»(.<.)(a^\(Z(W))«)I(stab(a<.,6) = G) < Pi['=»(z<.)((a(W))-i((A(W))«)\(Z(W))«); 
since = ° M<fc ''' i'^ '^^us suffices to show that 

^(W)((^([fcl))-l((^([fe]))G)\(^([fc]))G) ^ ^ 

for sufficiently fine a. 

Now observe that if z G ^(I'^'D is not G-invariant (i.e. z ^ (Z'^^'^l'')'^), then (since the algebra of clopen 
subsets in sub-Cantor spaces separate points) there exists a colouring a : Z ^ A such that a'^'^l-' (z) is also 
not G-invariant. This property is then inherited by all refinements of a. As a consequence we see that 

for all z e Z*^!*^!^. The claim ( |9T] ) then follows from the dominated convergence theorem (Lemma [3. 5 2b . 

□ 

3.7.4 Decoupling 

Let y be a finite vertex set, let z e Z^^^ be drawn at random with law fi'^^\ let a :~ a^^^ (z) G A*-^-*, and 
let X G Xk^i be drawn independently at random with law lyk-i- We then draw ^ G S with law rjx, and set 
w G Z(^) to be the point w := C<fc(a: i^iO)- We split z = {z^k.Zk), a = (a<fe,afe), and w = (w</c, Wfe) 
in the usual manner. 

Let us temporarily freeze z, a, x, so that the only remaining source of randomness comes from ^. The 
lower order components w<fe of w do not depend on and are now deterministic; indeed, we have w^k = 
(<k{a<k, x). If we split the top component Wk as Wk = {wk [e)^fz^vy then we see that each piece Wk [e 
depends on ^ via the formula 

zL^Pm^^^Ha^k,ak))). 

From this and Definition l3.72l (and (l89]l). we see that Wk [e is distributed (for fixed z, a, x) according to the 
law 

^e,stab(al,),afcte,C<i(a<fcU,2;) ^ Pe,stab(o te):afc U ,t«<fc U ■ 

In particular, we almost surely have the constraint 

lee (Z^^l f^HaU)^ (92) 

thus Wk [e needs to inherit all the symmetries that a [e has. 

From Definition 13.721 we also see that for ei , . . . , e„ G (^) , the pieces Wk [e^, ■ ■ ■ ,Wk Le„ are jointly 
independent so long as the a , . . . , a |.e„ are pairwise distinguishable. 
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On the other hand, if e, e' e (^) are such that a [e and a [gi are indistinguishable, thus we have a [e' = 
^('^)(a U) for some (f) e Inj(e, e'), then Wk [e and Wk [e' are coupled together via the constraint 

Wk[e=Z^^l{wk[e')- (93) 

Note that (|92] | can be viewed as the special case of e = e' of (|93] |. 

Motivated by the above discussion, for every h g A^^^^ let i?b be the set of all triples (e, e', 0), where 
e,e' G (^) and G Inj(e,e') is such that A'^'^\h |,e') = & [e, thus i?b collects all the ways in which 
components of b are indistinguishable from each other. The set i?f, is a groupoid, in the sense that 

• For every e G (]^), the triple (e, e, ide) lies in R\,. 

• If (e, e', (f)) lies in then (e', e, 0^^) lies in Ri,. 

• If (e, e', (f) and (e', e", V') lie in Rb, then (e, e", ip o (p) lies in i?b. 

Observe that for any e G (^), the stabiliser stab(6 [e) of 6 restricted to e can be recovered from Rb by the 
formula 

stab(fe te) = {0 G Inj(e, e) : (e, e, 0) G i?b}. 

Let us call e,e' G (^) R-indistinguishable for some groupoid R if there exists G Inj(e,e') with 
(e, e', (/)) G R, and R-distinguishable otherwise. As i? is a groupoid, the property of being _R-indistinguishable 
is an equivalence relation. 

Given a groupoid R, an element b G and an element y G -^^^^ we then define the probability mea- 

sure (Jv,R,b,y G Pr(Z'^^) to be the unique probability distribution of a random variable w = (it;<A:, Wk) G 
Z(^) such that 

• w<k = y; 

• For each e G (j), Wk [e has the distribution of Pe.Gc,bU,j/U' where Ge < Inj(e,e) is the group 
Ge :== {0 G Inj (e, e) : (e, e» G i?}; 

• For any (e, e', 0) G R, we have the constraint (l93l l: 

• For any ei,...,e„ G (^) which are pairwise i?-distinguishable, the random variables Wk tei 
, . . . ,Wk Le„ are jointly independent. 

One can construct (Jv,R,b,y more explicitly by choosing one representative e from each i?-indistinguishable 
equivalence class, selecting Wk [e independently at random for each such representative with law Pe,G^,b[^,y[^, 
and then extending to all other e by ( |93] l. 

By the previous discussion, we see that for fixed z, a, x, w is distributed according to the law (Jv.Ra,ak,w^k- 

We would like to remove the couplings (|92] |. (l93T l from this distribution. To this end, we define the trivial 
groupoid Rq {(e, e, idg) : e G (^)}- We would like to assert that the probability measure av.Ra,ak,w^k 
is close to cry._Ro,afc,to<fc in the total variation norm || • \\m(^z(^)) on Z^^\ as defined in Appendix lAl This 
is accomplished by the following key estimate. 
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Proposition 3.76 {crv,Ra,ak,w^k approximates a-v.Ro-ak.w^k^- Let V be a finite vertex set, let z S Z'^^^ be 
drawn at random with law /i^^-', let a := a'^'^^{z) € A'-^\ and let x £ X^^i be drawn independently at 
random with law Vk-i- Set w^k '■— C</c(fl<fei Then 

Proof. From the inductive hypothesis ( |86] | (or (|87] |) we have 

E ^ \\WvMa^^.b,b,w^u-Crv,Ro,b,w^A\M{Z>.v))-'^\Wv,R^^^,t,,b,z^u-Crv,Ro,b,z^k\\M{Zl.^))\ =Oa^oo(l) 

SO it suffices to show that 



The main difficulty here is to understand the effect of the constraints ( I92b . (I93b caused by Ra- The number 
of possible groupoids Ra is bounded independently of a. Thus it suffices to show that 

'EI{Ra = R)\Wv,R,ak.z^k ~ ^V,_Ro ,afc J I A/(Z(>') ) =0q^oo(1) (94) 

for each groupoid R. 

Fix R. Recall that z<fe is distributed with law /i^'', and for fixed z<fc, is distributed with law Q*^^^ (2:<fc), 

and so for any b G ^2^'' and fixed z<fc, au will equal 6 with probability Q''^\z<^k){Cv,{id} ,b) ■ Thus we 
can rewrite the left-hand side of (l94ll as 



Let C Z^^^ denote the set 

Zr := {y e Z(^) : U') = y U for all (e,e',0) G i?} 

and let Ar c A^^^ denote the set 

Afl := {6 e A(^) : A(^) ib [,,) = h \, for all (e, e', e i?} 

As in the proof of Proposition |3.75l we can use the fact that clopen subsets in sub-Cantor spaces separate 
points to conclude that 

for each y G Z^^ , and hence by Lemma [3.52l 
or in other words 
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Since we have 



we may thus apply Markov's inequahty and locate an exceptional set E C Z^^^ x A^^j! with 



E Q^'''(y)(C^y,{id},6)l((y,&)ei?) = 0.^00(1) 



such that 

Q(^)(y)(Cy,{id},6) >0 (95) 

and 

Q^''\v){Cv,{iA}AZR) = Oa^oo(l)Q^^'(y)(C^y,{id},6) (96) 
for all {y,b) e Z'^^^ X A^^^\E. 

Fix this set E. To finish the proof of ( l94l i. it thus suffices to show that 

uniformly for all (y, 6) e Z^^^ x a'l,}\E with 

^—'yHv),b^R- (97) 

Fix ?/, 6 as above. From (|95]| (and the fc-independence of Py, and hence of Q) we see that fe. {id}, h [e,y [e) 
is good for every e G (^) . Thus by Definition l3.71l we have 

Pe,{id},bte,yU = (Q'^^Hu U)|C'e,{id},6lJ 

and hence (by the fc-independence of Q again) we see from construction of a' that 

Crv..Ro,b,y = {Q''^Ky)\Cv,{id},b)- 

From (l96b and Lemma lATI we thus have 

\\<^V,Ro,b,y - {Q'"'^Hy)\Cv,{id}M H Zr)\\m(^z(v)) = Oq^oo(I) 

SO by the triangle inequality it suffices to show that 

hv^RAy - iQ^''Hy)\Cvs<i},br)ZR)\\Miz(^n) = oa^oo(l). (98) 

Let w be drawn using law crv,B.,b,y, and let w' be drawn using law (Q'-^-' (2/)l^v.{id},6 H Z/;). The lower 
order components w<fc, w'^i. of w, are both equal to b, so we focus on the top order components Wk , w^, 
which we split as {wk U)eg('^) ™d {w'f. [e)^^(^'-j respectively. 

If ei, . . . , e„ G (]^) are pairwise i?-distinguishable, then by construction of av,R,b,y we have that Wk Lei 
, . . . ,Wk [e^ ctre jointly independent. Conversely, if e, e' are i?-distinguishable, thus (e, e', 0) E R for 
some (p G Inj(e, e'), then from ( |93] | we have the constraint 
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Now we observe that the random variables w'f. [e obey exactly the same independence and constraint 
properties. Indeed, if (e, e', 0) G R, then the constraint 



holds almost surely, since w is constrained to lie in Zfi almost surely. On the other hand, if ei, . . . , e„ G 
(^) are pairwise i?-distinguishable, and thus lie in disjoint equivalence classes of i?-indistinguishability, 
then we claim that the random variables w'^. , . . . , wj. [e^ are jointly independent. Indeed, this claim 
is clearly true if w' is drawn with law Q'^^^ (as all of the [e are jointly independent in this case), and 
the conditioning to Cy H Zji only couples together those pairs w'^. [e, w'j^ [e' which lie in the same 
equivalence class. 

In view of the above discussion (and the fact that the cardinality of (^) is independent of a), we see that 
in order to conclude ( |98] |. it suffices to show that for each e e (^) separately, the laws of Wk te and [f. 
differ in M{Z^l) norm by Oq^oo (1), uniformly in y and 6. 

Fix e. From the definition of av.R.b,y, we see that Wk [e is distributed according to the law Pe,G^,b[^,y[c- 
The distribution of w'^ Le is more comphcated. However, by (|96] l we know that this law differs from the 
measure irv-te ° (.Q^^\y)\Cv,{id] ,b)^ where ttv^c : z'^^j} z'^l is the restriction map, by Oq,^oo(1) in 
the total variation norm M(z'lI). Thus it suffices to show that 



Pe,G^,bU,yU - ^V^e O (Q^ ' {y)\Cv,{id} ,b)\ 



M(Z[ 



= k 



(!)• 



But since (and hence Q) is fc-independent, we have 



Meanwhile, from (|95] |. (|96] | we have 




(99) 



and thus by Definition l3.71l 



Our task is thus to show that 



But from (l96l l, the inclusion ( l99l l and the fc-independence of Q once again, we have 

Q^^KV U)(Ce,{id},bu\Ce.G,,&u) =Oa^oo(l) 



(!)• 



and the claim follows from Lemma lATl 



□ 
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3.7.5 Approximate absolute continuity 



We can now quickly prove (|85] |. We can phrase this claim in probabilistic language as follows. Let z € 
Z'^^ be drawn at random with law \x^^^ , let a :— a'^^^ (z) G A'^^\ let x e X^^i be drawn independently 
with law Vk-i, let ^ e S be drawn with law r/^, and let w := C<k{o-, {x, ^)) e Z^^\ Let e > be arbitrary. 
Our task is to show that if a is sufficiently fine depending on e, then the distribution of w is e-absolutely 
continuous with respect to fi'-^\ Thus, let E C Z^-^^ be a measurable set such that /i*^^' (E) = 0. Our task 
is to show that 

P(w e E)<e. (100) 

From (l33]l we have = P^^^^ o ^^^^ Since ^^^\E) = 0, we conclude that the set E' := {y e 

Z^^"* : P^\y){E) > 0} has measure zero with respect to /i^''. By the inductive hypothesis dSSl ). we 

already know that the distribution of w^k G ^<^^ is e/4-absolutely continuous with respect to /i^'' if a is 
sufficiently fine. Thus we have 

Piw<k e E') < e/4. 
Furthermore, by Proposition [335] we see that 

P(([fc],stab(a),afc, w<fe) bad ) < e/4 
for a sufficiently fine, which implies that 

P(([fc],{id},afc,u;<fc)bad) <e/4. 

Also, by Proposition 13 . 761 and Markov's inequality, we have 

P{\\crV,B.^Mk,w^k - <^V,Ro,ak,w^J\M{Zl.^)) > ^ I ^) < e/4 

if a is sufficiently fine. 

Now let us fix z, a, x (and hence w<fc), and condition on the events that w<:k ^ E' (so P^^^ {w<:k){E) = 0) 
and that 

([fc],{id},afc,u'<fc) good ; ||crv,fl„,Q,,,«,<fc - cry,i?o,afc,u,< J|m(z(v)) < e/4. (101) 

By the preceding discussion, the event ( IIOII ) occurs with probability at least 1 — 3e/4. As discussed 
previously, the random variable w now has the distribution of (Tv,Ra.ak.w^k- dlOll ). we thus have the 
conditional probability estimate 

P{w e E\z, a, x) < avM.a,ak,w^>, (E) + e/4. 

But as {[k], {id}, Ofc, w<fc) is good, we see from construction of av,Ro,a^,w^k (and the ^-independence of 

Pk) that (Tv.Ro-ak.w^k is absolutely continuous with respect to Pj:^\ and thus by ( IIOII ) we have <Jv.Ro,ak,w^k (E) = 
0. Integrating over z, a, x and applying the union bound we obtain the claim jlOOl ). 

3.7.6 Convergence to the diagonal 

Now, we verify ( |86] |. We shall modify the argument used to establish Lemma [3.621 Fix V,H,F as in 
the Proposition; we may normalise F to be bounded in norm by 1. As in the proof of Lemma [3.621 it is 
convenient to use the probabiUstic formulation ( [87] |. Let z e Z^^^ be drawn at random with law fi'^^K and 
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then for fixed z, let x € Xk-i be drawn independently at random with law Vk-i, C G ^ drawn with law 

r]x, and set a := a^^-' (2) and w := (^jj (a, x). Our task is to show that 

E||F(z)-FH||h =o„^oo(l), 
where the decay rate Oa^oo (1) is allowed to depend on V, F and if. 

As usual, we decompose z = (z<fe, Zk), a ~ {a<ck, Ofc), and w — {w^k, Wk)- From the inductive hypothe- 
sis dSTl l we have 

Pia^^'^Hz^k) ^ c^^''Hw<k)) = o„^oo(l). 
Since o^*^^' {z<k) — a<k, it thus suffices to show that 

nF{z) - Fiw)\\HliS) = o„^oo(l) (102) 

where S is the event that 

a^(''\w<k) = a<k. (103) 

For fixed z,a,x (and hence w<fe), we recall that w has the distribution of cry afc,to<fc- Thus we can 
express the left-hand side of (1102b as 



E( / ||F(z) - Fiy)\\H dav,R^,a,,n,,Jy))I{S). 
From Proposition l3.76l (and the boundedness of F) we have 

£(/ \\F{z)-F{y)\\Hdav,R^^a,,^,,{y))I{S)<^{( \\F{z)^F{y)\\H dav,R,,a,,^^,{y))AS)+Oc^oo{l) 
and so it suffices to show that 



E( / \\F{z) - F{y)\\H dav,R.,a,,^^M)AS) = o„^oo(l). 
Using (1103b . we can bound the left-hand side by 

E f \\F{z) - F{y)\\H day^„,(_,.,(^^^),,^),„^^(j/)). 
By the triangle inequality, we can bound this in turn by the sum of 

n\F{z)-Ga,{w^k)\\H 

and 

where Ga^ '■ Z^^^} — > H, Ja^ : z'^^f} — > R are the bounded measurable functions 



and 



JaA^Kk)-^ I l|Ga,(w</c) - i^(2/)|k C^C^y_i^o,(a:^^(^)(«;<fc),aO,t«<A.(2^)■ 
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From the inductive hypothesis dSTl ) we have 

E ^ ||Gfc(u-<fe)-Gb(z<fc)|| 



(V) 



and 

E ^ I Jh(w<fe) - J6(z<fc)| = Oa^oo(l) 

and so by the triangle inequahty it suffices to show that 

E||F(z) - Ga,iz<k)\\H = Oa-.oo(l) (104) 

and 

(1). (105) 



Let us temporarily freeze z<fe (and thus a<fe), then z has the distribution of (^</c)- In particular, for 
any b £ '■^^ probability that ~ b (conditioning on z<fe) is equal to p'^^ {z^k){Gl), where 



Thus we see that those b for which Pi^\z<:k){Cl^) = will almost surely not be equal to a^; in other 
words, we almost surely have 

^r(^<fe)(c:j>o. 

From Definition l3.71l we conclude that (V, {id} , a/j , z<fe ) is almost surely good. Since Pk is fc-independent, 
we conclude that {e^{iA},ak te,^<fc Le) is also almost surely good for all e S {^^. From this, the 
fc-independence of Pk again, and the definition of (Jv.,Ro.ak.z^k^ we conclude that 



almost surely. Also, note that for any b G ^2^' , the distribution of z conditioned to the event = & is also 
given by {Pj,^^ (^</c)|C'',fc ). From this, we see that the left-hand sides of ( 11041 ) and dlOSb are both equal to 

E PPi^)iCb) [ \\Fiy)~ [ Fiu){PP{v,du)\C',)\\H{P^''\v,dy)\C',)d^^^J,\v). 



From Lemma [3. 531 we have 



E ^^^(CO / mv)- F{u){Pl,''\v,du)\C',)\\H{Pn^,dy)K)df,^^Jiv)^o^^^il) 



for all V £ Z^f} . The claim then follows from Lemma D.521 

This (finally!) completes the proof of Proposition [323] and thus Proposition l3.58l which in turn completes 
the proof of all the local repairability results claimed in the introduction. 
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A Some measure theory and probability 



In this appendix we recall some notions from measure theory and probability which we will rely on to 
establish our positive results. 

We will work throughout this paper with sub-Cantor spaces (as defined in Definition l3.1b . All of the nota- 
tion here however extends to the larger category of standard Borel spaces, i.e. a Polish space (a complete 
separable metrisable space), together with their Borel cr-algebra, which is generated by the open sets. 

If X is a sub-Cantor space, we will write Pr(X) for the space of all probability Borel measures on X. 
This is a convex subset of the space M{X) of all real finite measures on X, equipped with the usual total 
variation norm 



yUiix) ImI(^) - sup{|m(S) - -E^FcX, disjoint}. 



An important operation for us will be that of conditioning: if /i G Pr{X) is a probability measure and 
£^ C X is an event with ^{E) > 0, we define the conditioning {fJ.\E) e Pt{X) of to £^ to be the 
probability measure defined by the usual formula 

('''^^^^^ - -JliET- 

The following computation is easily verified: 

Lemma A.l (Conditioning by high probability events is mild). Let fi e Pt{X) and E C X be such that 
^(-5-) > 1 - e for some < e < 1/2. Then \\^, - {^\E)\\m{x) ^ £■ 



The space M{X) (and hence Pr(X)) comes equipped with the vague topology (or weak-* topology), 
defined as the topology induced by the functionals j-^ f for all bounded continuous supported /. 
The following lemma is well-known: 

Lemma A.2 (Prokhorov's theorem). Let X be a sub-Cantor space, and let fin be a sequence of measures 
in Pr(X). Then there is some subsequence /i„^ o//in which converges vaguely to another measure G 
Pr(X). 



The space Py{X) also comes with a a-algebra, induced by the evaluation mappings ji m(^) for all 
measurable A d X. This allows us to introduce the notion of a probability kernel, which is fundamental to 
our arguments for our positive results: 

Definition A.3 (Probability kernels). Let X, Y be sub-Cantor spaces. A probability kernel from F to X 
is a measurable function P . Y Pt{X) from Y to Pt(X). We will use the notation P . Y ^ X to 
denote the fact that P is a probability kerne from YtoX.Ify^Y and f : X ^ R is measurable, we use 
Jx /(^) P{y,dx) to denote the integral of f against the measure P{y) G Pr{X). We call a probability 
kernel P : Y ^ X trivial if X is a point. 

Remark A.4. A probability kernel P : Y X can be viewed as describing the law for some random 
variable on X, where the distribution of that law depends on the value of a parameter y in Y. Indeed, one 
common way to construct probability kernels is to condition one random variable on the value of another; 
in measure-theoretic terms, this is closely related to the operation of disintegrating a measure with respect 
to a factor 
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Two important special cases of a probability kernel arise from probability measures and from measurable 
functions. Indeed, if /j. & Pr{X) is a probability measure, we can (by abuse of notation) identify fi with a 
probability kernel fi : pt X which maps the point in pt to /i. Similarly, if (f) : Y ^ X is a measurable 
function, we can (by further abuse of notation) identify with a probability kernel cf) -.Y ^ X which maps 
any point y € ^ to the Dirac mass S^(^y) at y. These abuses of notation shall be in entail throughout the 
paper. 

We now define two important notions on probability kernels, namely composition and product. 

Definition A.5 (Composition of kernels). IfP:Y-^X and Q : Z ~^Y are probability kernels between 
sub-Cantor spaces, we define composition P oQ -. Z X by the formula by 

PoQ{z){E) -.^ I^P{y){E)Q{z,dy) 

for all z £ Z and all measurable E c X. 

Example A.6 (Special cases of composition). Let (f> : Y ^ X and ip : Z ^ Y be measurable maps, 
which we then identify with probability kernels, and let /x € Pr(F) be a probability measure (which we 
also identify with a probability kernel). Then ^otpis just the usual composition ofcj) and ip, while (j)o ^is 
the pushforward of^i under cf). 

Remark A.7. For future reference we observe that a probability kernel P . Y X not only pushes 
forward probability measures ji G Pr(F) to probability measures P o n & Pv{X), but in fact can push 
forward arbitrary finite Borel measures fjbonY to finite Borel measures P o ^onX, by the formula 

Pon{E) := J^Py{E)dfi{y) 

for all measurable E c X. 

Definition A.8 (Product of kernels). // S is an at most countable set, and Pg Y Xs is a probability 
kernel between sub-Cantor spaces for each s G S, then we define the product ®g^g Pg '-Y WseS 
by defining ^seS iu) fi"" ^^ch y £ Y to be the product of the probability measures Pg [y) for s £ S. We 
also write P®^ for 0g^g P. 

Finally, we define the notion of one probability kernel being absolutely continuous with respect to another. 

Definition A.9 (Absolute continuity). If G (^re two probability measures on a sub-Cantor 

space, we say that n is absolutely continuous with respect to v, and write p, <^ u, if for every measurable 

E G X we have fi{E) = whenever i'{E) = 0. If P, P' : Y X are probability kernels, we say that P' 
is absolutely continuous with respect to P, and write P' <C P, if we have P'{y) ^ P{y)for all y Y. 

Example A.IO. Ifp € Pi'(-''^) is a probability measure, and E C X is such that 12(E) > 0, then (fi\E) <C 
II. 

The notion of absolute continuity is clearly a partial ordering on probability kernels between two given 
sub-Cantor spaces. It also interacts nicely with both composition and finite products: 

Lemma A.ll (Preservation of absolute continuity). • Let P,P' : Y X and Q,Q' : Z Y be 
probability kernels. IfP'<^P and Q' «; Q, then P' o Q' <^ P o Q. 

• Let S be a finite set, and for each s G S let Ps,P'a : Y Xg be probability kernels such that 
Pi « Pg. Then (S>s^s P's « ®ses Ps- 
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Proof. Both claims follow immediately from the Fubini-Tonelli theorem. 



□ 



In some of our arguments we will need a perturbed version of absolute continuity. 

Definition A.12 (e-absolute continuity). Let e > 0. If E Pr(X) are two probability measures on a 
sub-Cantor space, we say that ^ is e-absolutely continuous with respect to v, and write fj, <Ce if for 
every measurable E <Z X we have fi{E) < e whenever v{E) — 0. 

From the Lebesgue-Radon-Nikodym theorem we have several equivalent characterisations of e-absolute 
continuity: 

Proposition A.13 (Equivalent formulations of e-absolute continuity). Let e > 0, and let E Pi-{X) are 
two probability measures on a sub-Cantor space X. Then the following statements are equivalent: 

• /i is e-absolutely continuous with respect to v. 

• For every e' > e there exists (5 > such that we have ii{E) < e' for every measurable E C X with 
v{E) < 6. 

• There exists a compact set E d X with fi{E) < e and v{E) — such that 2{E'')fi <^ v. 
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